2026-03-27 20:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 20:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 20:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-27 20:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-27 20:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 20:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 20:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 20:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 20:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 8469f4dd0e29a62c
2026-03-27 20:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 20:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-27T20_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 20:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 20:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 20:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 20:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 20:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 20:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 20:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 20:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-27 20:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 20:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 20:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-27 20:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-27 20:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 20:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 20:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 20:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-27 20:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 20:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 20:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-27 20:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 20:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 20:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-27 20:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-27 20:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-27 20:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-27 20:30:16 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1659 | hits on page: 40
2026-03-27 20:30:16 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-27 20:30:16 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA69116%27 HTTP/1.1" 200 None
2026-03-27 20:30:16 [auto1.be] INFO: Scrape type for YA69116: 2
2026-03-27 20:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with identifier: YA69116
2026-03-27 20:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with scrape type 2
2026-03-27 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with scrape type 2
2026-03-27 20:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de, identifier: YA69116
2026-03-27 20:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with identifier: YA69116
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-27 20:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-27 20:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with identifier: YA69116
2026-03-27 20:30:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with identifier: YA69116 to the API
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:46:21Z',
 'fuel_type': 'diesel',
 'id': '9c5614c2-f10e-5a01-bd9e-46caaaa6d6de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA69116',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 217826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-16',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA69116%27 HTTP/1.1" 200 None
2026-03-27 20:30:16 [auto1.be] INFO: Saving data for YA69116: {'auction_closing_time': 1774716381.0, 'created_time': 1774438328.277793, 'last_price_update_time': 1774643416.848613}
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA69116') HTTP/1.1" 204 0
2026-03-27 20:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:16 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-27 20:30:16 [auto1.be] INFO: Scrape type for JD01885: 1
2026-03-27 20:30:16 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-27 20:30:16 [auto1.be] INFO: Scrape type for PL61351: 0
2026-03-27 20:30:16 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-27 20:30:16 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-27 20:30:16 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX19447%27 HTTP/1.1" 200 None
2026-03-27 20:30:16 [auto1.be] INFO: Scrape type for YX19447: 2
2026-03-27 20:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eea0263-7563-5753-b948-9c0195a86f59 with identifier: YX19447
2026-03-27 20:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eea0263-7563-5753-b948-9c0195a86f59 with scrape type 2
2026-03-27 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eea0263-7563-5753-b948-9c0195a86f59 with scrape type 2
2026-03-27 20:30:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3eea0263-7563-5753-b948-9c0195a86f59, identifier: YX19447
2026-03-27 20:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3eea0263-7563-5753-b948-9c0195a86f59 with identifier: YX19447
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-27 20:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3eea0263-7563-5753-b948-9c0195a86f59 with identifier: YX19447
2026-03-27 20:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3eea0263-7563-5753-b948-9c0195a86f59 with identifier: YX19447 to the API
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:25:28Z',
 'fuel_type': 'petrol',
 'id': '3eea0263-7563-5753-b948-9c0195a86f59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX19447',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 181428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-07',
 'seller_name': None,
 'title': 'Honda Civic 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2005}
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX19447%27 HTTP/1.1" 200 None
2026-03-27 20:30:17 [auto1.be] INFO: Saving data for YX19447: {'auction_closing_time': 1774715128.0, 'created_time': 1773952847.877053, 'last_price_update_time': 1774643417.648963}
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YX19447') HTTP/1.1" 204 0
2026-03-27 20:30:17 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-27 20:30:17 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-27 20:30:17 [auto1.be] INFO: Scrape type for YN02015: 1
2026-03-27 20:30:17 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-27 20:30:17 [auto1.be] INFO: Scrape type for EZ55101: 2
2026-03-27 20:30:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101
2026-03-27 20:30:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 514e9273-813b-58fb-9c98-e900f39e458d with scrape type 2
2026-03-27 20:30:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 514e9273-813b-58fb-9c98-e900f39e458d with scrape type 2
2026-03-27 20:30:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 514e9273-813b-58fb-9c98-e900f39e458d, identifier: EZ55101
2026-03-27 20:30:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101
2026-03-27 20:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101
2026-03-27 20:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101 to the API
2026-03-27 20:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:52:14Z',
 'fuel_type': 'petrol',
 'id': '514e9273-813b-58fb-9c98-e900f39e458d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ55101',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 149041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2021}
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-27 20:30:19 [auto1.be] INFO: Saving data for EZ55101: {'auction_closing_time': 1774716734.0, 'created_time': 1773779936.379094, 'last_price_update_time': 1774643419.100787}
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EZ55101') HTTP/1.1" 204 0
2026-03-27 20:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:19 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-27 20:30:19 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-27 20:30:19 [auto1.be] INFO: Scrape type for MK20825: 2
2026-03-27 20:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825
2026-03-27 20:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9060c77e-58a0-56e4-a70f-65ffc708ff7a with scrape type 2
2026-03-27 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9060c77e-58a0-56e4-a70f-65ffc708ff7a with scrape type 2
2026-03-27 20:30:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9060c77e-58a0-56e4-a70f-65ffc708ff7a, identifier: MK20825
2026-03-27 20:30:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-27 20:30:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825
2026-03-27 20:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825 to the API
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:05:00Z',
 'fuel_type': 'diesel',
 'id': '9060c77e-58a0-56e4-a70f-65ffc708ff7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK20825',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 184750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-04-20',
 'seller_name': None,
 'title': 'Lancia Delta 1.9 Turbodiesel TD LS',
 'transmission': 'manual',
 'trim': 'TD LS',
 'year': 1999}
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-27 20:30:19 [auto1.be] INFO: Saving data for MK20825: {'auction_closing_time': 1774713900.0, 'created_time': 1773237091.551978, 'last_price_update_time': 1774643419.665625}
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MK20825') HTTP/1.1" 204 0
2026-03-27 20:30:19 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-27 20:30:19 [auto1.be] INFO: Scrape type for GK88228: 2
2026-03-27 20:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228
2026-03-27 20:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with scrape type 2
2026-03-27 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with scrape type 2
2026-03-27 20:30:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53, identifier: GK88228
2026-03-27 20:30:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228
2026-03-27 20:30:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228
2026-03-27 20:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228 to the API
2026-03-27 20:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:59:02Z',
 'fuel_type': 'petrol',
 'id': '2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK88228',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 161920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-10',
 'seller_name': None,
 'title': 'BMW 4er 420i Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-27 20:30:20 [auto1.be] INFO: Saving data for GK88228: {'auction_closing_time': 1774717142.0, 'created_time': 1773390869.438716, 'last_price_update_time': 1774643420.233154}
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GK88228') HTTP/1.1" 204 0
2026-03-27 20:30:20 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-27 20:30:20 [auto1.be] INFO: Scrape type for WV47829: 2
2026-03-27 20:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829
2026-03-27 20:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eadca8bf-3085-55c5-bef2-d61f7a749a42 with scrape type 2
2026-03-27 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eadca8bf-3085-55c5-bef2-d61f7a749a42 with scrape type 2
2026-03-27 20:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eadca8bf-3085-55c5-bef2-d61f7a749a42, identifier: WV47829
2026-03-27 20:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829
2026-03-27 20:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829
2026-03-27 20:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829 to the API
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:48:58Z',
 'fuel_type': 'diesel',
 'id': 'eadca8bf-3085-55c5-bef2-d61f7a749a42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV47829',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 111467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.5 EcoBlue TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2021}
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-27 20:30:20 [auto1.be] INFO: Saving data for WV47829: {'auction_closing_time': 1774716538.0, 'created_time': 1773909053.334438, 'last_price_update_time': 1774643420.748187}
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV47829') HTTP/1.1" 204 0
2026-03-27 20:30:20 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX87020%27 HTTP/1.1" 200 None
2026-03-27 20:30:20 [auto1.be] INFO: Scrape type for KX87020: 2
2026-03-27 20:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6bc164b-0c0d-529c-b25e-a400eddbe6a5 with identifier: KX87020
2026-03-27 20:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6bc164b-0c0d-529c-b25e-a400eddbe6a5 with scrape type 2
2026-03-27 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6bc164b-0c0d-529c-b25e-a400eddbe6a5 with scrape type 2
2026-03-27 20:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6bc164b-0c0d-529c-b25e-a400eddbe6a5, identifier: KX87020
2026-03-27 20:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6bc164b-0c0d-529c-b25e-a400eddbe6a5 with identifier: KX87020
2026-03-27 20:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6bc164b-0c0d-529c-b25e-a400eddbe6a5 with identifier: KX87020
2026-03-27 20:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6bc164b-0c0d-529c-b25e-a400eddbe6a5 with identifier: KX87020 to the API
2026-03-27 20:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:49:15Z',
 'fuel_type': 'diesel',
 'id': 'b6bc164b-0c0d-529c-b25e-a400eddbe6a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX87020',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 81758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-18',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2018}
2026-03-27 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX87020%27 HTTP/1.1" 200 None
2026-03-27 20:30:21 [auto1.be] INFO: Saving data for KX87020: {'auction_closing_time': 1774716555.0, 'created_time': 1773233633.111193, 'last_price_update_time': 1774643421.98329}
2026-03-27 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KX87020') HTTP/1.1" 204 0
2026-03-27 20:30:22 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-27 20:30:22 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK97810%27 HTTP/1.1" 200 None
2026-03-27 20:30:22 [auto1.be] INFO: Scrape type for AK97810: 2
2026-03-27 20:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 186ff907-1392-59b5-9c74-d27905b78624 with identifier: AK97810
2026-03-27 20:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 186ff907-1392-59b5-9c74-d27905b78624 with scrape type 2
2026-03-27 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 186ff907-1392-59b5-9c74-d27905b78624 with scrape type 2
2026-03-27 20:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 186ff907-1392-59b5-9c74-d27905b78624, identifier: AK97810
2026-03-27 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD01885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 186ff907-1392-59b5-9c74-d27905b78624 with identifier: AK97810
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-27 20:30:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 186ff907-1392-59b5-9c74-d27905b78624 with identifier: AK97810
2026-03-27 20:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 186ff907-1392-59b5-9c74-d27905b78624 with identifier: AK97810 to the API
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:49:02Z',
 'fuel_type': 'diesel',
 'id': '186ff907-1392-59b5-9c74-d27905b78624',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK97810',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S40',
 'odometer': 120981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-24',
 'seller_name': None,
 'title': 'Volvo S40 1.6 DRIVe Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2011}
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK97810%27 HTTP/1.1" 200 None
2026-03-27 20:30:22 [auto1.be] INFO: Saving data for AK97810: {'auction_closing_time': 1774716542.0, 'created_time': 1773137593.593069, 'last_price_update_time': 1774643422.684554}
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AK97810') HTTP/1.1" 204 0
2026-03-27 20:30:22 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-27 20:30:22 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-27 20:30:22 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-27 20:30:22 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-27 20:30:22 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET15377%27 HTTP/1.1" 200 None
2026-03-27 20:30:22 [auto1.be] INFO: Scrape type for ET15377: 2
2026-03-27 20:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a65256-6b4c-5bf4-84b9-d6dbe0965499 with identifier: ET15377
2026-03-27 20:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a65256-6b4c-5bf4-84b9-d6dbe0965499 with scrape type 2
2026-03-27 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15a65256-6b4c-5bf4-84b9-d6dbe0965499 with scrape type 2
2026-03-27 20:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15a65256-6b4c-5bf4-84b9-d6dbe0965499, identifier: ET15377
2026-03-27 20:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15a65256-6b4c-5bf4-84b9-d6dbe0965499 with identifier: ET15377
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-27 20:30:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15a65256-6b4c-5bf4-84b9-d6dbe0965499 with identifier: ET15377
2026-03-27 20:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15a65256-6b4c-5bf4-84b9-d6dbe0965499 with identifier: ET15377 to the API
2026-03-27 20:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:10:31Z',
 'fuel_type': 'petrol',
 'id': '15a65256-6b4c-5bf4-84b9-d6dbe0965499',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET15377',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 95333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-28',
 'seller_name': None,
 'title': 'BMW 5er 530i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-27 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET15377%27 HTTP/1.1" 200 None
2026-03-27 20:30:23 [auto1.be] INFO: Saving data for ET15377: {'auction_closing_time': 1774714231.0, 'created_time': 1773136372.136624, 'last_price_update_time': 1774643423.411743}
2026-03-27 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET15377') HTTP/1.1" 204 0
2026-03-27 20:30:23 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-27 20:30:23 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-27 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB07200%27 HTTP/1.1" 200 None
2026-03-27 20:30:23 [auto1.be] INFO: Scrape type for UB07200: 2
2026-03-27 20:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bee1d340-cdbd-5412-aa65-328964353ef6 with identifier: UB07200
2026-03-27 20:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee1d340-cdbd-5412-aa65-328964353ef6 with scrape type 2
2026-03-27 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bee1d340-cdbd-5412-aa65-328964353ef6 with scrape type 2
2026-03-27 20:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bee1d340-cdbd-5412-aa65-328964353ef6, identifier: UB07200
2026-03-27 20:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bee1d340-cdbd-5412-aa65-328964353ef6 with identifier: UB07200
2026-03-27 20:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bee1d340-cdbd-5412-aa65-328964353ef6 with identifier: UB07200
2026-03-27 20:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bee1d340-cdbd-5412-aa65-328964353ef6 with identifier: UB07200 to the API
2026-03-27 20:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:52Z',
 'fuel_type': 'petrol',
 'id': 'bee1d340-cdbd-5412-aa65-328964353ef6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB07200',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 143534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2020}
2026-03-27 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB07200%27 HTTP/1.1" 200 None
2026-03-27 20:30:24 [auto1.be] INFO: Saving data for UB07200: {'auction_closing_time': 1774716652.0, 'created_time': 1773134048.841618, 'last_price_update_time': 1774643424.852328}
2026-03-27 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UB07200') HTTP/1.1" 204 0
2026-03-27 20:30:24 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1659 | hits on page: 40
2026-03-27 20:30:24 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-27 20:30:24 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-27 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-27 20:30:24 [auto1.be] INFO: Scrape type for JK00802: 1
2026-03-27 20:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN02015/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:24 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-27 20:30:24 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-27 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA69116%27 HTTP/1.1" 200 None
2026-03-27 20:30:24 [auto1.be] INFO: Scrape type for YA69116: 0
2026-03-27 20:30:24 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-27 20:30:24 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-27 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ36955%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for PZ36955: 1
2026-03-27 20:30:25 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/JD01885/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-27 20:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for PL61351: 0
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX19447%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for YX19447: 0
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN43275%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for ZN43275: 2
2026-03-27 20:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b92baa64-290c-5886-9e15-5c3d8ee3a985 with identifier: ZN43275
2026-03-27 20:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b92baa64-290c-5886-9e15-5c3d8ee3a985 with scrape type 2
2026-03-27 20:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b92baa64-290c-5886-9e15-5c3d8ee3a985 with scrape type 2
2026-03-27 20:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b92baa64-290c-5886-9e15-5c3d8ee3a985, identifier: ZN43275
2026-03-27 20:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b92baa64-290c-5886-9e15-5c3d8ee3a985 with identifier: ZN43275
2026-03-27 20:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b92baa64-290c-5886-9e15-5c3d8ee3a985 with identifier: ZN43275
2026-03-27 20:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b92baa64-290c-5886-9e15-5c3d8ee3a985 with identifier: ZN43275 to the API
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:07Z',
 'fuel_type': 'diesel',
 'id': 'b92baa64-290c-5886-9e15-5c3d8ee3a985',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN43275',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 178568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-27',
 'seller_name': None,
 'title': 'BMW 3er 318d Luxury Line',
 'transmission': 'manual',
 'trim': 'Luxury Line',
 'year': 2015}
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN43275%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Saving data for ZN43275: {'auction_closing_time': 1774716547.0, 'created_time': 1773135600.743367, 'last_price_update_time': 1774643425.53973}
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN43275') HTTP/1.1" 204 0
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for EZ55101: 0
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for MK20825: 0
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for GK88228: 0
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for WV47829: 0
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX87020%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for KX87020: 0
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK97810%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for AK97810: 0
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET15377%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for ET15377: 0
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB07200%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for UB07200: 0
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-27 20:30:25 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV76677%27 HTTP/1.1" 200 None
2026-03-27 20:30:25 [auto1.be] INFO: Scrape type for AV76677: 2
2026-03-27 20:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 327d8bce-ccc4-59c4-9468-504f604d33b2 with identifier: AV76677
2026-03-27 20:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327d8bce-ccc4-59c4-9468-504f604d33b2 with scrape type 2
2026-03-27 20:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 327d8bce-ccc4-59c4-9468-504f604d33b2 with scrape type 2
2026-03-27 20:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 327d8bce-ccc4-59c4-9468-504f604d33b2, identifier: AV76677
2026-03-27 20:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 327d8bce-ccc4-59c4-9468-504f604d33b2 with identifier: AV76677
2026-03-27 20:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 327d8bce-ccc4-59c4-9468-504f604d33b2 with identifier: AV76677
2026-03-27 20:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 327d8bce-ccc4-59c4-9468-504f604d33b2 with identifier: AV76677 to the API
2026-03-27 20:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:40:12Z',
 'fuel_type': 'petrol',
 'id': '327d8bce-ccc4-59c4-9468-504f604d33b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV76677',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 36690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-20',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2022}
2026-03-27 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV76677%27 HTTP/1.1" 200 None
2026-03-27 20:30:26 [auto1.be] INFO: Saving data for AV76677: {'auction_closing_time': 1774716012.0, 'created_time': 1773133731.523064, 'last_price_update_time': 1774643426.287717}
2026-03-27 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AV76677') HTTP/1.1" 204 0
2026-03-27 20:30:26 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-27 20:30:26 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-27 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-27 20:30:26 [auto1.be] INFO: Scrape type for BA37972: 2
2026-03-27 20:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972
2026-03-27 20:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ed1cb58-a86a-5424-a984-2ac5d160db97 with scrape type 2
2026-03-27 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ed1cb58-a86a-5424-a984-2ac5d160db97 with scrape type 2
2026-03-27 20:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ed1cb58-a86a-5424-a984-2ac5d160db97, identifier: BA37972
2026-03-27 20:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972
2026-03-27 20:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972
2026-03-27 20:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972 to the API
2026-03-27 20:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:08:04Z',
 'fuel_type': 'petrol',
 'id': '4ed1cb58-a86a-5424-a984-2ac5d160db97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA37972',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara',
 'odometer': 66980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-02-04',
 'seller_name': None,
 'title': 'Citroen Xsara 1.4 Millesime',
 'transmission': 'manual',
 'trim': 'Millesime',
 'year': 2001}
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-27 20:30:27 [auto1.be] INFO: Saving data for BA37972: {'auction_closing_time': 1774714084.0, 'created_time': 1773922616.315566, 'last_price_update_time': 1774643427.617397}
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BA37972') HTTP/1.1" 204 0
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN43275%27 HTTP/1.1" 200 None
2026-03-27 20:30:27 [auto1.be] INFO: Scrape type for ZN43275: 0
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV76677%27 HTTP/1.1" 200 None
2026-03-27 20:30:27 [auto1.be] INFO: Scrape type for AV76677: 0
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-27 20:30:27 [auto1.be] INFO: Scrape type for BA37972: 0
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN48445%27 HTTP/1.1" 200 None
2026-03-27 20:30:27 [auto1.be] INFO: Scrape type for JN48445: 1
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-27 20:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: MY55708
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: XK15851
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: AU94213
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU94213%27 HTTP/1.1" 200 None
2026-03-27 20:30:27 [auto1.be] INFO: Scrape type for AU94213: 1
2026-03-27 20:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: MY55708
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: XK15851
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: AU94213
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: AM90339
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM90339%27 HTTP/1.1" 200 None
2026-03-27 20:30:27 [auto1.be] INFO: Scrape type for AM90339: 2
2026-03-27 20:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c80ccad-cd86-55be-843e-2eca3dd1c104 with identifier: AM90339
2026-03-27 20:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c80ccad-cd86-55be-843e-2eca3dd1c104 with scrape type 2
2026-03-27 20:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c80ccad-cd86-55be-843e-2eca3dd1c104 with scrape type 2
2026-03-27 20:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c80ccad-cd86-55be-843e-2eca3dd1c104, identifier: AM90339
2026-03-27 20:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:27 [auto1.be] INFO: Found listing with ID: AM90339
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM90339%27 HTTP/1.1" 200 None
2026-03-27 20:30:27 [auto1.be] INFO: Scrape type for AM90339: 2
2026-03-27 20:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c80ccad-cd86-55be-843e-2eca3dd1c104 with scrape type 2
2026-03-27 20:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c80ccad-cd86-55be-843e-2eca3dd1c104 with scrape type 2
2026-03-27 20:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c80ccad-cd86-55be-843e-2eca3dd1c104, identifier: AM90339
2026-03-27 20:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c80ccad-cd86-55be-843e-2eca3dd1c104 with identifier: AM90339
2026-03-27 20:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c80ccad-cd86-55be-843e-2eca3dd1c104 with identifier: AM90339
2026-03-27 20:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c80ccad-cd86-55be-843e-2eca3dd1c104 with identifier: AM90339 to the API
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:04Z',
 'fuel_type': 'diesel',
 'id': '2c80ccad-cd86-55be-843e-2eca3dd1c104',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM90339',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 182707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2018}
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM90339%27 HTTP/1.1" 200 None
2026-03-27 20:30:28 [auto1.be] INFO: Saving data for AM90339: {'auction_closing_time': 1774717084.0, 'created_time': 1773137149.327319, 'last_price_update_time': 1774643428.295049}
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM90339') HTTP/1.1" 204 0
2026-03-27 20:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c80ccad-cd86-55be-843e-2eca3dd1c104 with identifier: AM90339
2026-03-27 20:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c80ccad-cd86-55be-843e-2eca3dd1c104 with identifier: AM90339
2026-03-27 20:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c80ccad-cd86-55be-843e-2eca3dd1c104 with identifier: AM90339 to the API
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:04Z',
 'fuel_type': 'diesel',
 'id': '2c80ccad-cd86-55be-843e-2eca3dd1c104',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM90339',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 182707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2018}
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM90339%27 HTTP/1.1" 200 None
2026-03-27 20:30:28 [auto1.be] INFO: Saving data for AM90339: {'auction_closing_time': 1774717084.0, 'created_time': 1773137149.327319, 'last_price_update_time': 1774643428.616785}
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM90339') HTTP/1.1" 204 0
2026-03-27 20:30:28 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-27 20:30:28 [auto1.be] INFO: Scrape type for FF69776: 2
2026-03-27 20:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776
2026-03-27 20:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f01f9a6-2504-51a9-9159-c4055b50959b with scrape type 2
2026-03-27 20:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f01f9a6-2504-51a9-9159-c4055b50959b with scrape type 2
2026-03-27 20:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f01f9a6-2504-51a9-9159-c4055b50959b, identifier: FF69776
2026-03-27 20:30:28 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-27 20:30:28 [auto1.be] INFO: Scrape type for FF69776: 2
2026-03-27 20:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f01f9a6-2504-51a9-9159-c4055b50959b with scrape type 2
2026-03-27 20:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f01f9a6-2504-51a9-9159-c4055b50959b with scrape type 2
2026-03-27 20:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f01f9a6-2504-51a9-9159-c4055b50959b, identifier: FF69776
2026-03-27 20:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776
2026-03-27 20:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776
2026-03-27 20:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776 to the API
2026-03-27 20:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:02:45Z',
 'fuel_type': 'diesel',
 'id': '8f01f9a6-2504-51a9-9159-c4055b50959b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF69776',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 86505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'Jaguar E-Pace D180 R-Dynamic AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic AWD',
 'year': 2020}
2026-03-27 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-27 20:30:29 [auto1.be] INFO: Saving data for FF69776: {'auction_closing_time': 1774713765.0, 'created_time': 1773132813.305858, 'last_price_update_time': 1774643429.248132}
2026-03-27 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FF69776') HTTP/1.1" 204 0
2026-03-27 20:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776
2026-03-27 20:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776
2026-03-27 20:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776 to the API
2026-03-27 20:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:02:45Z',
 'fuel_type': 'diesel',
 'id': '8f01f9a6-2504-51a9-9159-c4055b50959b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF69776',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 86505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'Jaguar E-Pace D180 R-Dynamic AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic AWD',
 'year': 2020}
2026-03-27 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-27 20:30:29 [auto1.be] INFO: Saving data for FF69776: {'auction_closing_time': 1774713765.0, 'created_time': 1773132813.305858, 'last_price_update_time': 1774643429.489607}
2026-03-27 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FF69776') HTTP/1.1" 204 0
2026-03-27 20:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK00802/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ36955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN48445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD01885> (referer: https://www.auto1.com/v1/car-details-view/JD01885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU94213/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885
2026-03-27 20:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7aadd58-ffec-5042-90af-62accda44cb4 with scrape type 1
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7aadd58-ffec-5042-90af-62accda44cb4
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_4b12ff965b90352d5a62a8aad8435385.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_4b12ff965b90352d5a62a8aad8435385.jpg not downloaded yet
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_e21484710bfe497660d43439e39d9f72.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_e21484710bfe497660d43439e39d9f72.jpg not downloaded yet
2026-03-27 20:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN02015> (referer: https://www.auto1.com/v1/car-details-view/YN02015/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_9a0c148fd3d1b19d0a8d9fd33530b033.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_9a0c148fd3d1b19d0a8d9fd33530b033.jpg not downloaded yet
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_ab3d2cc0348a2fa7b4d96f7a9840b146.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_ab3d2cc0348a2fa7b4d96f7a9840b146.jpg not downloaded yet
2026-03-27 20:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_d832cf41e3774e5c9b0c3a8930375509.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_d832cf41e3774e5c9b0c3a8930375509.jpg not downloaded yet
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_4edc550f626cd52d50f1168586e0b71f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_4edc550f626cd52d50f1168586e0b71f.jpg not downloaded yet
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_4dd0f7a7392fb0cc5b25f31fe089e16f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_4dd0f7a7392fb0cc5b25f31fe089e16f.jpg not downloaded yet
2026-03-27 20:30:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_03a86c2ce8bf60c5a4aa2654e5001c1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_03a86c2ce8bf60c5a4aa2654e5001c1d.jpg not downloaded yet
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_ce35326aa3dbf31924900789f4723794.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_ce35326aa3dbf31924900789f4723794.jpg not downloaded yet
2026-03-27 20:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015
2026-03-27 20:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7715cd53-ea1d-5c62-8a22-dd974965764b with scrape type 1
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7715cd53-ea1d-5c62-8a22-dd974965764b
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F48%252F0248b06b07cff740acaea7728b77a7b4%252Fpa%252FYN02015_c2fddb59202bedffc983a36dd488c764.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_c2fddb59202bedffc983a36dd488c764.jpg already downloaded
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F48%252F0248b06b07cff740acaea7728b77a7b4%252Fpa%252FYN02015_d78581426a52798abd5b69a8ac259903.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_d78581426a52798abd5b69a8ac259903.jpg already downloaded
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F48%252F0248b06b07cff740acaea7728b77a7b4%252Fpa%252FYN02015_92ca6d7fc09b2c1b207d8524df0906a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_92ca6d7fc09b2c1b207d8524df0906a9.jpg already downloaded
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F48%252F0248b06b07cff740acaea7728b77a7b4%252Fpa%252FYN02015_680e04d299b04d2214c04b9d27167511.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_680e04d299b04d2214c04b9d27167511.jpg already downloaded
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F48%252F0248b06b07cff740acaea7728b77a7b4%252Fpa%252FYN02015_4dcf9c928a7b22774e156d9d85fd558a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_4dcf9c928a7b22774e156d9d85fd558a.jpg already downloaded
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F48%252F0248b06b07cff740acaea7728b77a7b4%252Fpa%252FYN02015_d8997609757d5726ffa12811d0b11187.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_d8997609757d5726ffa12811d0b11187.jpg already downloaded
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F48%252F0248b06b07cff740acaea7728b77a7b4%252Fpa%252FYN02015_63ca6be2e5dbfa1c9b8f03631e45b2a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_63ca6be2e5dbfa1c9b8f03631e45b2a7.jpg already downloaded
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F48%252F0248b06b07cff740acaea7728b77a7b4%252Fpa%252FYN02015_62783afeb953bec019a0780ece39766f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_62783afeb953bec019a0780ece39766f.jpg already downloaded
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F48%252F0248b06b07cff740acaea7728b77a7b4%252Fpa%252FYN02015_ca7a842ec051897e995bcb059b27e442.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_ca7a842ec051897e995bcb059b27e442.jpg already downloaded
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F48%252F0248b06b07cff740acaea7728b77a7b4%252Fpa%252FYN02015_8d66258cd409ab86249fa7dc47a845f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_8d66258cd409ab86249fa7dc47a845f5.jpg already downloaded
2026-03-27 20:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7715cd53-ea1d-5c62-8a22-dd974965764b, identifier: YN02015
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_8842137d432e3f79ee3a7736ab992d8c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_8842137d432e3f79ee3a7736ab992d8c.jpg not downloaded yet
2026-03-27 20:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-27 20:30:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015
2026-03-27 20:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015 to the API
2026-03-27 20:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YN02015>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:49:40Z',
 'fuel_type': 'hybrid',
 'id': '7715cd53-ea1d-5c62-8a22-dd974965764b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN02015',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 149154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_c2fddb59202bedffc983a36dd488c764.jpg',
                'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_d78581426a52798abd5b69a8ac259903.jpg',
                'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_92ca6d7fc09b2c1b207d8524df0906a9.jpg',
                'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_680e04d299b04d2214c04b9d27167511.jpg',
                'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_4dcf9c928a7b22774e156d9d85fd558a.jpg',
                'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_d8997609757d5726ffa12811d0b11187.jpg',
                'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_63ca6be2e5dbfa1c9b8f03631e45b2a7.jpg',
                'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_62783afeb953bec019a0780ece39766f.jpg',
                'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_ca7a842ec051897e995bcb059b27e442.jpg',
                'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_8d66258cd409ab86249fa7dc47a845f5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7715cd53-ea1d-5c62-8a22-dd974965764b/7715cd53-ea1d-5c62-8a22-dd974965764b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_c2fddb59202bedffc983a36dd488c764.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7715cd53-ea1d-5c62-8a22-dd974965764b/7715cd53-ea1d-5c62-8a22-dd974965764b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_d78581426a52798abd5b69a8ac259903.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7715cd53-ea1d-5c62-8a22-dd974965764b/7715cd53-ea1d-5c62-8a22-dd974965764b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_92ca6d7fc09b2c1b207d8524df0906a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7715cd53-ea1d-5c62-8a22-dd974965764b/7715cd53-ea1d-5c62-8a22-dd974965764b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_680e04d299b04d2214c04b9d27167511.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7715cd53-ea1d-5c62-8a22-dd974965764b/7715cd53-ea1d-5c62-8a22-dd974965764b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_4dcf9c928a7b22774e156d9d85fd558a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7715cd53-ea1d-5c62-8a22-dd974965764b/7715cd53-ea1d-5c62-8a22-dd974965764b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_d8997609757d5726ffa12811d0b11187.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7715cd53-ea1d-5c62-8a22-dd974965764b/7715cd53-ea1d-5c62-8a22-dd974965764b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_63ca6be2e5dbfa1c9b8f03631e45b2a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7715cd53-ea1d-5c62-8a22-dd974965764b/7715cd53-ea1d-5c62-8a22-dd974965764b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_62783afeb953bec019a0780ece39766f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7715cd53-ea1d-5c62-8a22-dd974965764b/7715cd53-ea1d-5c62-8a22-dd974965764b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_ca7a842ec051897e995bcb059b27e442.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7715cd53-ea1d-5c62-8a22-dd974965764b/7715cd53-ea1d-5c62-8a22-dd974965764b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/48/0248b06b07cff740acaea7728b77a7b4/pa/YN02015_8d66258cd409ab86249fa7dc47a845f5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 350e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-27 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-27 20:30:31 [auto1.be] INFO: Saving data for YN02015: {'created_time': 1774643431.644295, 'last_price_update_time': 1774643431.644306, 'auction_closing_time': 1774716580.0}
2026-03-27 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN02015') HTTP/1.1" 204 0
2026-03-27 20:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK00802> (referer: https://www.auto1.com/v1/car-details-view/JK00802/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:31 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1659 | hits on page: 40
2026-03-27 20:30:31 [auto1.be] INFO: Found listing with ID: TA93870
2026-03-27 20:30:31 [auto1.be] INFO: Found listing with ID: ZR94706
2026-03-27 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR94706%27 HTTP/1.1" 200 None
2026-03-27 20:30:31 [auto1.be] INFO: Scrape type for ZR94706: 2
2026-03-27 20:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a848ef3-3c7c-5326-a168-497d3ca8482b with identifier: ZR94706
2026-03-27 20:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a848ef3-3c7c-5326-a168-497d3ca8482b with scrape type 2
2026-03-27 20:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a848ef3-3c7c-5326-a168-497d3ca8482b with scrape type 2
2026-03-27 20:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9a848ef3-3c7c-5326-a168-497d3ca8482b, identifier: ZR94706
2026-03-27 20:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9a848ef3-3c7c-5326-a168-497d3ca8482b with identifier: ZR94706
2026-03-27 20:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9a848ef3-3c7c-5326-a168-497d3ca8482b with identifier: ZR94706
2026-03-27 20:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9a848ef3-3c7c-5326-a168-497d3ca8482b with identifier: ZR94706 to the API
2026-03-27 20:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:31:40Z',
 'fuel_type': 'diesel',
 'id': '9a848ef3-3c7c-5326-a168-497d3ca8482b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR94706',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 320502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-24',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI ultra',
 'transmission': 'manual',
 'trim': 'ultra',
 'year': 2014}
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR94706%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [auto1.be] INFO: Saving data for ZR94706: {'auction_closing_time': 1774715500.0, 'created_time': 1773225383.68094, 'last_price_update_time': 1774643432.055841}
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR94706') HTTP/1.1" 204 0
2026-03-27 20:30:32 [auto1.be] INFO: Found listing with ID: XL14792
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL14792%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [auto1.be] INFO: Scrape type for XL14792: 2
2026-03-27 20:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 388528f8-7474-595d-9fc4-61b239e981bb with identifier: XL14792
2026-03-27 20:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 388528f8-7474-595d-9fc4-61b239e981bb with scrape type 2
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 388528f8-7474-595d-9fc4-61b239e981bb with scrape type 2
2026-03-27 20:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 388528f8-7474-595d-9fc4-61b239e981bb, identifier: XL14792
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item b7aadd58-ffec-5042-90af-62accda44cb4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 20:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 388528f8-7474-595d-9fc4-61b239e981bb with identifier: XL14792
2026-03-27 20:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 388528f8-7474-595d-9fc4-61b239e981bb with identifier: XL14792
2026-03-27 20:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 388528f8-7474-595d-9fc4-61b239e981bb with identifier: XL14792 to the API
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:48:04Z',
 'fuel_type': 'petrol',
 'id': '388528f8-7474-595d-9fc4-61b239e981bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL14792',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 189697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-27',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2019}
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL14792%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [auto1.be] INFO: Saving data for XL14792: {'auction_closing_time': 1774716484.0, 'created_time': 1773137749.091203, 'last_price_update_time': 1774643432.535686}
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL14792') HTTP/1.1" 204 0
2026-03-27 20:30:32 [auto1.be] INFO: Found listing with ID: JF06459
2026-03-27 20:30:32 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [auto1.be] INFO: Scrape type for KL42374: 1
2026-03-27 20:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802
2026-03-27 20:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a115b03-bae1-5659-b73c-a9b56f44c662 with scrape type 1
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a115b03-bae1-5659-b73c-a9b56f44c662
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F54%252F3e54627742627add78c5a2ac7dafbfb2%252Fpa%252FJK00802_ca0b423d36c433a674cf9f7bc20c36a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_ca0b423d36c433a674cf9f7bc20c36a0.jpg already downloaded
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F54%252F3e54627742627add78c5a2ac7dafbfb2%252Fpa%252FJK00802_1aedf439520084da5c19020d225bc9b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_1aedf439520084da5c19020d225bc9b1.jpg already downloaded
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F54%252F3e54627742627add78c5a2ac7dafbfb2%252Fpa%252FJK00802_1fd21bcb65eb2faf51427096a56b3d5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_1fd21bcb65eb2faf51427096a56b3d5f.jpg already downloaded
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F54%252F3e54627742627add78c5a2ac7dafbfb2%252Fpa%252FJK00802_d43c31ef40b1002fe92f4077ab2d4eb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_d43c31ef40b1002fe92f4077ab2d4eb3.jpg already downloaded
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F54%252F3e54627742627add78c5a2ac7dafbfb2%252Fpa%252FJK00802_7ccdd3683bbd8c76c5b75b1eb970020c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_7ccdd3683bbd8c76c5b75b1eb970020c.jpg already downloaded
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F54%252F3e54627742627add78c5a2ac7dafbfb2%252Fpa%252FJK00802_d033d9317f453172e8fc777d2fd23420.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_d033d9317f453172e8fc777d2fd23420.jpg already downloaded
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F54%252F3e54627742627add78c5a2ac7dafbfb2%252Fpa%252FJK00802_39aa39af41f0238ae6ea461854dd5560.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_39aa39af41f0238ae6ea461854dd5560.jpg already downloaded
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F54%252F3e54627742627add78c5a2ac7dafbfb2%252Fpa%252FJK00802_01a2cc7b3ae655f05c530eafa43df8af.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_01a2cc7b3ae655f05c530eafa43df8af.jpg already downloaded
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F54%252F3e54627742627add78c5a2ac7dafbfb2%252Fpa%252FJK00802_272c5acb3778f97e8572432fba233bff.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_272c5acb3778f97e8572432fba233bff.jpg already downloaded
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F54%252F3e54627742627add78c5a2ac7dafbfb2%252Fpa%252FJK00802_befb882d760c0615ad7bef6c7b11a9b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_befb882d760c0615ad7bef6c7b11a9b5.jpg already downloaded
2026-03-27 20:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3a115b03-bae1-5659-b73c-a9b56f44c662, identifier: JK00802
2026-03-27 20:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-27 20:30:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802
2026-03-27 20:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802 to the API
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JK00802>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:45:22Z',
 'fuel_type': 'diesel',
 'id': '3a115b03-bae1-5659-b73c-a9b56f44c662',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK00802',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 182688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_ca0b423d36c433a674cf9f7bc20c36a0.jpg',
                'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_1aedf439520084da5c19020d225bc9b1.jpg',
                'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_1fd21bcb65eb2faf51427096a56b3d5f.jpg',
                'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_d43c31ef40b1002fe92f4077ab2d4eb3.jpg',
                'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_7ccdd3683bbd8c76c5b75b1eb970020c.jpg',
                'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_d033d9317f453172e8fc777d2fd23420.jpg',
                'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_39aa39af41f0238ae6ea461854dd5560.jpg',
                'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_01a2cc7b3ae655f05c530eafa43df8af.jpg',
                'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_272c5acb3778f97e8572432fba233bff.jpg',
                'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_befb882d760c0615ad7bef6c7b11a9b5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a115b03-bae1-5659-b73c-a9b56f44c662/3a115b03-bae1-5659-b73c-a9b56f44c662_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_ca0b423d36c433a674cf9f7bc20c36a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a115b03-bae1-5659-b73c-a9b56f44c662/3a115b03-bae1-5659-b73c-a9b56f44c662_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_1aedf439520084da5c19020d225bc9b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a115b03-bae1-5659-b73c-a9b56f44c662/3a115b03-bae1-5659-b73c-a9b56f44c662_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_1fd21bcb65eb2faf51427096a56b3d5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a115b03-bae1-5659-b73c-a9b56f44c662/3a115b03-bae1-5659-b73c-a9b56f44c662_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_d43c31ef40b1002fe92f4077ab2d4eb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a115b03-bae1-5659-b73c-a9b56f44c662/3a115b03-bae1-5659-b73c-a9b56f44c662_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_7ccdd3683bbd8c76c5b75b1eb970020c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a115b03-bae1-5659-b73c-a9b56f44c662/3a115b03-bae1-5659-b73c-a9b56f44c662_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_d033d9317f453172e8fc777d2fd23420.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a115b03-bae1-5659-b73c-a9b56f44c662/3a115b03-bae1-5659-b73c-a9b56f44c662_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_39aa39af41f0238ae6ea461854dd5560.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a115b03-bae1-5659-b73c-a9b56f44c662/3a115b03-bae1-5659-b73c-a9b56f44c662_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_01a2cc7b3ae655f05c530eafa43df8af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a115b03-bae1-5659-b73c-a9b56f44c662/3a115b03-bae1-5659-b73c-a9b56f44c662_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_272c5acb3778f97e8572432fba233bff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a115b03-bae1-5659-b73c-a9b56f44c662/3a115b03-bae1-5659-b73c-a9b56f44c662_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/54/3e54627742627add78c5a2ac7dafbfb2/pa/JK00802_befb882d760c0615ad7bef6c7b11a9b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2006}
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-27 20:30:33 [auto1.be] INFO: Saving data for JK00802: {'created_time': 1774643433.28042, 'last_price_update_time': 1774643433.280431, 'auction_closing_time': 1774716322.0}
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JK00802') HTTP/1.1" 204 0
2026-03-27 20:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_9a0c148fd3d1b19d0a8d9fd33530b033.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_e21484710bfe497660d43439e39d9f72.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_4b12ff965b90352d5a62a8aad8435385.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_ab3d2cc0348a2fa7b4d96f7a9840b146.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_d832cf41e3774e5c9b0c3a8930375509.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:30:33 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-27 20:30:33 [auto1.be] INFO: Scrape type for MK30308: 1
2026-03-27 20:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ36955> (referer: https://www.auto1.com/v1/car-details-view/PZ36955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN48445> (referer: https://www.auto1.com/v1/car-details-view/JN48445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:33 [auto1.be] INFO: Found listing with ID: YX04122
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX04122%27 HTTP/1.1" 200 None
2026-03-27 20:30:33 [auto1.be] INFO: Scrape type for YX04122: 2
2026-03-27 20:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 635891ae-ba84-52b5-b266-3d3b3243fc79 with identifier: YX04122
2026-03-27 20:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 635891ae-ba84-52b5-b266-3d3b3243fc79 with scrape type 2
2026-03-27 20:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 635891ae-ba84-52b5-b266-3d3b3243fc79 with scrape type 2
2026-03-27 20:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 635891ae-ba84-52b5-b266-3d3b3243fc79, identifier: YX04122
2026-03-27 20:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 635891ae-ba84-52b5-b266-3d3b3243fc79 with identifier: YX04122
2026-03-27 20:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 635891ae-ba84-52b5-b266-3d3b3243fc79 with identifier: YX04122
2026-03-27 20:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 635891ae-ba84-52b5-b266-3d3b3243fc79 with identifier: YX04122 to the API
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:33:47Z',
 'fuel_type': 'petrol',
 'id': '635891ae-ba84-52b5-b266-3d3b3243fc79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX04122',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 115951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-22',
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX04122%27 HTTP/1.1" 200 None
2026-03-27 20:30:33 [auto1.be] INFO: Saving data for YX04122: {'auction_closing_time': 1774715627.0, 'created_time': 1773135945.993884, 'last_price_update_time': 1774643433.708973}
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YX04122') HTTP/1.1" 204 0
2026-03-27 20:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item b7aadd58-ffec-5042-90af-62accda44cb4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 20:30:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item b7aadd58-ffec-5042-90af-62accda44cb4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 20:30:33 [auto1.be] INFO: Found listing with ID: PZ99747
2026-03-27 20:30:33 [auto1.be] INFO: Found listing with ID: XX88636
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX88636%27 HTTP/1.1" 200 None
2026-03-27 20:30:33 [auto1.be] INFO: Scrape type for XX88636: 1
2026-03-27 20:30:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item b7aadd58-ffec-5042-90af-62accda44cb4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 20:30:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 20:30:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 20:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bcf090>
2026-03-27 20:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2111
2026-03-27 20:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7aadd58-ffec-5042-90af-62accda44cb4/b7aadd58-ffec-5042-90af-62accda44cb4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_9a0c148fd3d1b19d0a8d9fd33530b033.jpg') HTTP/1.1" 204 0
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_9a0c148fd3d1b19d0a8d9fd33530b033.jpg saved to cache
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7aadd58-ffec-5042-90af-62accda44cb4
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3583e65d0>
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7aadd58-ffec-5042-90af-62accda44cb4/b7aadd58-ffec-5042-90af-62accda44cb4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_e21484710bfe497660d43439e39d9f72.jpg') HTTP/1.1" 204 0
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_e21484710bfe497660d43439e39d9f72.jpg saved to cache
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7aadd58-ffec-5042-90af-62accda44cb4
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b68910>
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7aadd58-ffec-5042-90af-62accda44cb4/b7aadd58-ffec-5042-90af-62accda44cb4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_4b12ff965b90352d5a62a8aad8435385.jpg') HTTP/1.1" 204 0
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_4b12ff965b90352d5a62a8aad8435385.jpg saved to cache
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7aadd58-ffec-5042-90af-62accda44cb4
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf53d0>
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7aadd58-ffec-5042-90af-62accda44cb4/b7aadd58-ffec-5042-90af-62accda44cb4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_ab3d2cc0348a2fa7b4d96f7a9840b146.jpg') HTTP/1.1" 204 0
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_ab3d2cc0348a2fa7b4d96f7a9840b146.jpg saved to cache
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7aadd58-ffec-5042-90af-62accda44cb4
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bc1d50>
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7aadd58-ffec-5042-90af-62accda44cb4/b7aadd58-ffec-5042-90af-62accda44cb4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff8%252Fa1f88ae04d62e0fe5cb73a8b422c5211%252Fpa%252FJD01885_d832cf41e3774e5c9b0c3a8930375509.jpg') HTTP/1.1" 204 0
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_d832cf41e3774e5c9b0c3a8930375509.jpg saved to cache
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7aadd58-ffec-5042-90af-62accda44cb4
2026-03-27 20:30:34 [auto1.be] INFO: Found listing with ID: CH97070
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH97070%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [auto1.be] INFO: Scrape type for CH97070: 2
2026-03-27 20:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bfeeee4-103d-549f-8117-7526760f60fc with identifier: CH97070
2026-03-27 20:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bfeeee4-103d-549f-8117-7526760f60fc with scrape type 2
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bfeeee4-103d-549f-8117-7526760f60fc with scrape type 2
2026-03-27 20:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8bfeeee4-103d-549f-8117-7526760f60fc, identifier: CH97070
2026-03-27 20:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU94213> (referer: https://www.auto1.com/v1/car-details-view/AU94213/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99de3119-7500-58db-872c-1894a28f2dab with identifier: PZ36955
2026-03-27 20:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99de3119-7500-58db-872c-1894a28f2dab with scrape type 1
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99de3119-7500-58db-872c-1894a28f2dab
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F80%252F7b80a758e6fc2ed4d763c3d7089333e8%252Fpa%252FPZ36955_6d83389493ba8d0ad3ed2e7473c0b964.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_6d83389493ba8d0ad3ed2e7473c0b964.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F80%252F7b80a758e6fc2ed4d763c3d7089333e8%252Fpa%252FPZ36955_235af56823be809e0dc69aa242607447.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_235af56823be809e0dc69aa242607447.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F80%252F7b80a758e6fc2ed4d763c3d7089333e8%252Fpa%252FPZ36955_502663cc34601039afab546d333c943f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_502663cc34601039afab546d333c943f.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F80%252F7b80a758e6fc2ed4d763c3d7089333e8%252Fpa%252FPZ36955_89ea0d161f0a180b532e3a7863035f01.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_89ea0d161f0a180b532e3a7863035f01.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F80%252F7b80a758e6fc2ed4d763c3d7089333e8%252Fpa%252FPZ36955_83ccfbaad8db85525b04b007862b68ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_83ccfbaad8db85525b04b007862b68ad.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F80%252F7b80a758e6fc2ed4d763c3d7089333e8%252Fpa%252FPZ36955_3cd89b649b88b6569b3b6b6c42ef789d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_3cd89b649b88b6569b3b6b6c42ef789d.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F80%252F7b80a758e6fc2ed4d763c3d7089333e8%252Fpa%252FPZ36955_a3aa64c47cd7b25dbb54a4c2bd8180c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_a3aa64c47cd7b25dbb54a4c2bd8180c3.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F80%252F7b80a758e6fc2ed4d763c3d7089333e8%252Fpa%252FPZ36955_4bfc7c5e8471cf0ff746eb5bf7f4c5bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_4bfc7c5e8471cf0ff746eb5bf7f4c5bf.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F80%252F7b80a758e6fc2ed4d763c3d7089333e8%252Fpa%252FPZ36955_6be1b787886e9bed85e2598372a21b40.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_6be1b787886e9bed85e2598372a21b40.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F80%252F7b80a758e6fc2ed4d763c3d7089333e8%252Fpa%252FPZ36955_bd4883cea300f957f116aaace3757938.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_bd4883cea300f957f116aaace3757938.jpg already downloaded
2026-03-27 20:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 99de3119-7500-58db-872c-1894a28f2dab, identifier: PZ36955
2026-03-27 20:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fac7191-09fb-59a0-8242-371630a0bd8e with identifier: JN48445
2026-03-27 20:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fac7191-09fb-59a0-8242-371630a0bd8e with scrape type 1
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fac7191-09fb-59a0-8242-371630a0bd8e
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F2e%252Fb22e12ce561524775991950762e97242%252Fpa%252FJN48445_a18fdc3d5e203295d6f0c4abbe151924.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_a18fdc3d5e203295d6f0c4abbe151924.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F2e%252Fb22e12ce561524775991950762e97242%252Fpa%252FJN48445_d91c0cad1d693fdbc4c2280893de8445.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_d91c0cad1d693fdbc4c2280893de8445.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F2e%252Fb22e12ce561524775991950762e97242%252Fpa%252FJN48445_d90d4882a7251369241acf8223c37462.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_d90d4882a7251369241acf8223c37462.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F2e%252Fb22e12ce561524775991950762e97242%252Fpa%252FJN48445_7cc67f887c16a51ae11923a98b6f8a31.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_7cc67f887c16a51ae11923a98b6f8a31.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F2e%252Fb22e12ce561524775991950762e97242%252Fpa%252FJN48445_54f89d78287c9f7c9db1e37efe44a937.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_54f89d78287c9f7c9db1e37efe44a937.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F2e%252Fb22e12ce561524775991950762e97242%252Fpa%252FJN48445_0252647ff3c7d50bb3d3dda7fa015421.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_0252647ff3c7d50bb3d3dda7fa015421.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F2e%252Fb22e12ce561524775991950762e97242%252Fpa%252FJN48445_34a0cf3b544e86ea81612c94c44670c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_34a0cf3b544e86ea81612c94c44670c0.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F2e%252Fb22e12ce561524775991950762e97242%252Fpa%252FJN48445_49dbd2dda3d2cc78036e93e551bfe7ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_49dbd2dda3d2cc78036e93e551bfe7ad.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F2e%252Fb22e12ce561524775991950762e97242%252Fpa%252FJN48445_0d23621fad6a0a55137a422a83c20199.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_0d23621fad6a0a55137a422a83c20199.jpg already downloaded
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F2e%252Fb22e12ce561524775991950762e97242%252Fpa%252FJN48445_2aefd5f1faf21aee7bd88c7e14eef520.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_2aefd5f1faf21aee7bd88c7e14eef520.jpg already downloaded
2026-03-27 20:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7fac7191-09fb-59a0-8242-371630a0bd8e, identifier: JN48445
2026-03-27 20:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8bfeeee4-103d-549f-8117-7526760f60fc with identifier: CH97070
2026-03-27 20:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8bfeeee4-103d-549f-8117-7526760f60fc with identifier: CH97070
2026-03-27 20:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8bfeeee4-103d-549f-8117-7526760f60fc with identifier: CH97070 to the API
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:40:47Z',
 'fuel_type': 'diesel',
 'id': '8bfeeee4-103d-549f-8117-7526760f60fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH97070',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 77574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-26',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH97070%27 HTTP/1.1" 200 None
2026-03-27 20:30:35 [auto1.be] INFO: Saving data for CH97070: {'auction_closing_time': 1774716047.0, 'created_time': 1773135672.722277, 'last_price_update_time': 1774643435.221185}
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH97070') HTTP/1.1" 204 0
2026-03-27 20:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 99de3119-7500-58db-872c-1894a28f2dab with identifier: PZ36955
2026-03-27 20:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 99de3119-7500-58db-872c-1894a28f2dab with identifier: PZ36955
2026-03-27 20:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 99de3119-7500-58db-872c-1894a28f2dab with identifier: PZ36955 to the API
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PZ36955>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:33:43Z',
 'fuel_type': 'diesel',
 'id': '99de3119-7500-58db-872c-1894a28f2dab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ36955',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '5er',
 'odometer': 293367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_6d83389493ba8d0ad3ed2e7473c0b964.jpg',
                'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_235af56823be809e0dc69aa242607447.jpg',
                'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_502663cc34601039afab546d333c943f.jpg',
                'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_89ea0d161f0a180b532e3a7863035f01.jpg',
                'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_83ccfbaad8db85525b04b007862b68ad.jpg',
                'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_3cd89b649b88b6569b3b6b6c42ef789d.jpg',
                'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_a3aa64c47cd7b25dbb54a4c2bd8180c3.jpg',
                'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_4bfc7c5e8471cf0ff746eb5bf7f4c5bf.jpg',
                'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_6be1b787886e9bed85e2598372a21b40.jpg',
                'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_bd4883cea300f957f116aaace3757938.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99de3119-7500-58db-872c-1894a28f2dab/99de3119-7500-58db-872c-1894a28f2dab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_6d83389493ba8d0ad3ed2e7473c0b964.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99de3119-7500-58db-872c-1894a28f2dab/99de3119-7500-58db-872c-1894a28f2dab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_235af56823be809e0dc69aa242607447.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99de3119-7500-58db-872c-1894a28f2dab/99de3119-7500-58db-872c-1894a28f2dab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_502663cc34601039afab546d333c943f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99de3119-7500-58db-872c-1894a28f2dab/99de3119-7500-58db-872c-1894a28f2dab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_89ea0d161f0a180b532e3a7863035f01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99de3119-7500-58db-872c-1894a28f2dab/99de3119-7500-58db-872c-1894a28f2dab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_83ccfbaad8db85525b04b007862b68ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99de3119-7500-58db-872c-1894a28f2dab/99de3119-7500-58db-872c-1894a28f2dab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_3cd89b649b88b6569b3b6b6c42ef789d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99de3119-7500-58db-872c-1894a28f2dab/99de3119-7500-58db-872c-1894a28f2dab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_a3aa64c47cd7b25dbb54a4c2bd8180c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99de3119-7500-58db-872c-1894a28f2dab/99de3119-7500-58db-872c-1894a28f2dab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_4bfc7c5e8471cf0ff746eb5bf7f4c5bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99de3119-7500-58db-872c-1894a28f2dab/99de3119-7500-58db-872c-1894a28f2dab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_6be1b787886e9bed85e2598372a21b40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99de3119-7500-58db-872c-1894a28f2dab/99de3119-7500-58db-872c-1894a28f2dab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/80/7b80a758e6fc2ed4d763c3d7089333e8/pa/PZ36955_bd4883cea300f957f116aaace3757938.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ36955%27 HTTP/1.1" 200 None
2026-03-27 20:30:35 [auto1.be] INFO: Saving data for PZ36955: {'created_time': 1774643435.671395, 'last_price_update_time': 1774643435.671405, 'auction_closing_time': 1774715623.0}
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PZ36955') HTTP/1.1" 204 0
2026-03-27 20:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7fac7191-09fb-59a0-8242-371630a0bd8e with identifier: JN48445
2026-03-27 20:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7fac7191-09fb-59a0-8242-371630a0bd8e with identifier: JN48445
2026-03-27 20:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7fac7191-09fb-59a0-8242-371630a0bd8e with identifier: JN48445 to the API
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JN48445>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:59:29Z',
 'fuel_type': 'hybrid',
 'id': '7fac7191-09fb-59a0-8242-371630a0bd8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN48445',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 204507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_a18fdc3d5e203295d6f0c4abbe151924.jpg',
                'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_d91c0cad1d693fdbc4c2280893de8445.jpg',
                'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_d90d4882a7251369241acf8223c37462.jpg',
                'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_7cc67f887c16a51ae11923a98b6f8a31.jpg',
                'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_54f89d78287c9f7c9db1e37efe44a937.jpg',
                'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_0252647ff3c7d50bb3d3dda7fa015421.jpg',
                'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_34a0cf3b544e86ea81612c94c44670c0.jpg',
                'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_49dbd2dda3d2cc78036e93e551bfe7ad.jpg',
                'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_0d23621fad6a0a55137a422a83c20199.jpg',
                'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_2aefd5f1faf21aee7bd88c7e14eef520.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac7191-09fb-59a0-8242-371630a0bd8e/7fac7191-09fb-59a0-8242-371630a0bd8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_a18fdc3d5e203295d6f0c4abbe151924.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac7191-09fb-59a0-8242-371630a0bd8e/7fac7191-09fb-59a0-8242-371630a0bd8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_d91c0cad1d693fdbc4c2280893de8445.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac7191-09fb-59a0-8242-371630a0bd8e/7fac7191-09fb-59a0-8242-371630a0bd8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_d90d4882a7251369241acf8223c37462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac7191-09fb-59a0-8242-371630a0bd8e/7fac7191-09fb-59a0-8242-371630a0bd8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_7cc67f887c16a51ae11923a98b6f8a31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac7191-09fb-59a0-8242-371630a0bd8e/7fac7191-09fb-59a0-8242-371630a0bd8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_54f89d78287c9f7c9db1e37efe44a937.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac7191-09fb-59a0-8242-371630a0bd8e/7fac7191-09fb-59a0-8242-371630a0bd8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_0252647ff3c7d50bb3d3dda7fa015421.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac7191-09fb-59a0-8242-371630a0bd8e/7fac7191-09fb-59a0-8242-371630a0bd8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_34a0cf3b544e86ea81612c94c44670c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac7191-09fb-59a0-8242-371630a0bd8e/7fac7191-09fb-59a0-8242-371630a0bd8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_49dbd2dda3d2cc78036e93e551bfe7ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac7191-09fb-59a0-8242-371630a0bd8e/7fac7191-09fb-59a0-8242-371630a0bd8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_0d23621fad6a0a55137a422a83c20199.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac7191-09fb-59a0-8242-371630a0bd8e/7fac7191-09fb-59a0-8242-371630a0bd8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/2e/b22e12ce561524775991950762e97242/pa/JN48445_2aefd5f1faf21aee7bd88c7e14eef520.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid 4x2 Performance '
          'Line Plus',
 'transmission': 'automatic',
 'trim': '4x2 Performance Line Plus',
 'year': 2022}
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN48445%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [auto1.be] INFO: Saving data for JN48445: {'created_time': 1774643436.120258, 'last_price_update_time': 1774643436.12027, 'auction_closing_time': 1774717169.0}
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JN48445') HTTP/1.1" 204 0
2026-03-27 20:30:36 [auto1.be] INFO: Found listing with ID: TB53896
2026-03-27 20:30:36 [auto1.be] INFO: Found listing with ID: PL30549
2026-03-27 20:30:36 [auto1.be] INFO: Found listing with ID: JB83669
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB83669%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [auto1.be] INFO: Scrape type for JB83669: 1
2026-03-27 20:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:36 [auto1.be] INFO: Found listing with ID: FD92001
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD92001%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [auto1.be] INFO: Scrape type for FD92001: 2
2026-03-27 20:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23c2361e-cb17-5f93-81fc-3946abfb8540 with identifier: FD92001
2026-03-27 20:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c2361e-cb17-5f93-81fc-3946abfb8540 with scrape type 2
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23c2361e-cb17-5f93-81fc-3946abfb8540 with scrape type 2
2026-03-27 20:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23c2361e-cb17-5f93-81fc-3946abfb8540, identifier: FD92001
2026-03-27 20:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23c2361e-cb17-5f93-81fc-3946abfb8540 with identifier: FD92001
2026-03-27 20:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23c2361e-cb17-5f93-81fc-3946abfb8540 with identifier: FD92001
2026-03-27 20:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23c2361e-cb17-5f93-81fc-3946abfb8540 with identifier: FD92001 to the API
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:30:27Z',
 'fuel_type': 'petrol',
 'id': '23c2361e-cb17-5f93-81fc-3946abfb8540',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD92001',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 176754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-01',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD92001%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [auto1.be] INFO: Saving data for FD92001: {'auction_closing_time': 1774715427.0, 'created_time': 1773135990.567494, 'last_price_update_time': 1774643436.551065}
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FD92001') HTTP/1.1" 204 0
2026-03-27 20:30:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 380ac948-79d2-5acb-95b7-287b34b3a8d8 with identifier: AU94213
2026-03-27 20:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 380ac948-79d2-5acb-95b7-287b34b3a8d8 with scrape type 1
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 380ac948-79d2-5acb-95b7-287b34b3a8d8
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fab%252F54abac861d9aaf797967f2d9e234d435%252Fpa%252FAU94213_20384f1cb54e91fd9bbd51822bb103ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_20384f1cb54e91fd9bbd51822bb103ee.jpg already downloaded
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fab%252F54abac861d9aaf797967f2d9e234d435%252Fpa%252FAU94213_41e3cb3c4780774db09a2747ab00c84e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_41e3cb3c4780774db09a2747ab00c84e.jpg already downloaded
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fab%252F54abac861d9aaf797967f2d9e234d435%252Fpa%252FAU94213_e86188e13f28fe2887ea4bc1725066dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_e86188e13f28fe2887ea4bc1725066dd.jpg already downloaded
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fab%252F54abac861d9aaf797967f2d9e234d435%252Fpa%252FAU94213_e633a50ca7ad1b20d754a3a8cb2923f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_e633a50ca7ad1b20d754a3a8cb2923f1.jpg already downloaded
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fab%252F54abac861d9aaf797967f2d9e234d435%252Fpa%252FAU94213_46895dc0ef8b497fc40908e62f82c846.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_46895dc0ef8b497fc40908e62f82c846.jpg already downloaded
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fab%252F54abac861d9aaf797967f2d9e234d435%252Fpa%252FAU94213_8e248592d9e2899260e0615653c7280b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_8e248592d9e2899260e0615653c7280b.jpg already downloaded
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fab%252F54abac861d9aaf797967f2d9e234d435%252Fpa%252FAU94213_b970c68edb41147b160fe68ad2a009e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_b970c68edb41147b160fe68ad2a009e8.jpg already downloaded
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fab%252F54abac861d9aaf797967f2d9e234d435%252Fpa%252FAU94213_98c451d5492e68ec206fd834af5357dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_98c451d5492e68ec206fd834af5357dc.jpg already downloaded
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fab%252F54abac861d9aaf797967f2d9e234d435%252Fpa%252FAU94213_4ae734ed4fdb193dfe6b8661e18b36fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_4ae734ed4fdb193dfe6b8661e18b36fa.jpg already downloaded
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fab%252F54abac861d9aaf797967f2d9e234d435%252Fpa%252FAU94213_fec0d7bb930e47ac0440e4c47e3ecded.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_fec0d7bb930e47ac0440e4c47e3ecded.jpg already downloaded
2026-03-27 20:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 380ac948-79d2-5acb-95b7-287b34b3a8d8, identifier: AU94213
2026-03-27 20:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885
2026-03-27 20:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885
2026-03-27 20:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885 to the API
2026-03-27 20:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:37 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:59Z',
 'fuel_type': 'diesel',
 'id': 'b7aadd58-ffec-5042-90af-62accda44cb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD01885',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Mazda',
 'model': '6',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photo_urls': ['https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_4b12ff965b90352d5a62a8aad8435385.jpg',
                'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_e21484710bfe497660d43439e39d9f72.jpg',
                'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_9a0c148fd3d1b19d0a8d9fd33530b033.jpg',
                'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_ab3d2cc0348a2fa7b4d96f7a9840b146.jpg',
                'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_d832cf41e3774e5c9b0c3a8930375509.jpg',
                'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_4edc550f626cd52d50f1168586e0b71f.jpg',
                'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_4dd0f7a7392fb0cc5b25f31fe089e16f.jpg',
                'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_03a86c2ce8bf60c5a4aa2654e5001c1d.jpg',
                'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_ce35326aa3dbf31924900789f4723794.jpg',
                'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_8842137d432e3f79ee3a7736ab992d8c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aadd58-ffec-5042-90af-62accda44cb4/b7aadd58-ffec-5042-90af-62accda44cb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_4b12ff965b90352d5a62a8aad8435385.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aadd58-ffec-5042-90af-62accda44cb4/b7aadd58-ffec-5042-90af-62accda44cb4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_e21484710bfe497660d43439e39d9f72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aadd58-ffec-5042-90af-62accda44cb4/b7aadd58-ffec-5042-90af-62accda44cb4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_9a0c148fd3d1b19d0a8d9fd33530b033.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aadd58-ffec-5042-90af-62accda44cb4/b7aadd58-ffec-5042-90af-62accda44cb4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_ab3d2cc0348a2fa7b4d96f7a9840b146.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aadd58-ffec-5042-90af-62accda44cb4/b7aadd58-ffec-5042-90af-62accda44cb4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f8/a1f88ae04d62e0fe5cb73a8b422c5211/pa/JD01885_d832cf41e3774e5c9b0c3a8930375509.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Business-Line',
 'transmission': 'manual',
 'trim': 'Business-Line',
 'year': 2016}
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-27 20:30:37 [auto1.be] INFO: Saving data for JD01885: {'created_time': 1774643437.267415, 'last_price_update_time': 1774643437.267426, 'auction_closing_time': 1774716419.0}
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JD01885') HTTP/1.1" 204 0
2026-03-27 20:30:37 [auto1.be] INFO: Found listing with ID: LN19500
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LN19500%27 HTTP/1.1" 200 None
2026-03-27 20:30:37 [auto1.be] INFO: Scrape type for LN19500: 2
2026-03-27 20:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19a7a783-c94c-5522-a011-8b1fe04b0d9c with identifier: LN19500
2026-03-27 20:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19a7a783-c94c-5522-a011-8b1fe04b0d9c with scrape type 2
2026-03-27 20:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19a7a783-c94c-5522-a011-8b1fe04b0d9c with scrape type 2
2026-03-27 20:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 19a7a783-c94c-5522-a011-8b1fe04b0d9c, identifier: LN19500
2026-03-27 20:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 380ac948-79d2-5acb-95b7-287b34b3a8d8 with identifier: AU94213
2026-03-27 20:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 380ac948-79d2-5acb-95b7-287b34b3a8d8 with identifier: AU94213
2026-03-27 20:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 380ac948-79d2-5acb-95b7-287b34b3a8d8 with identifier: AU94213 to the API
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AU94213>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:55:38Z',
 'fuel_type': 'diesel',
 'id': '380ac948-79d2-5acb-95b7-287b34b3a8d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU94213',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 139510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_20384f1cb54e91fd9bbd51822bb103ee.jpg',
                'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_41e3cb3c4780774db09a2747ab00c84e.jpg',
                'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_e86188e13f28fe2887ea4bc1725066dd.jpg',
                'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_e633a50ca7ad1b20d754a3a8cb2923f1.jpg',
                'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_46895dc0ef8b497fc40908e62f82c846.jpg',
                'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_8e248592d9e2899260e0615653c7280b.jpg',
                'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_b970c68edb41147b160fe68ad2a009e8.jpg',
                'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_98c451d5492e68ec206fd834af5357dc.jpg',
                'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_4ae734ed4fdb193dfe6b8661e18b36fa.jpg',
                'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_fec0d7bb930e47ac0440e4c47e3ecded.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380ac948-79d2-5acb-95b7-287b34b3a8d8/380ac948-79d2-5acb-95b7-287b34b3a8d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_20384f1cb54e91fd9bbd51822bb103ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380ac948-79d2-5acb-95b7-287b34b3a8d8/380ac948-79d2-5acb-95b7-287b34b3a8d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_41e3cb3c4780774db09a2747ab00c84e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380ac948-79d2-5acb-95b7-287b34b3a8d8/380ac948-79d2-5acb-95b7-287b34b3a8d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_e86188e13f28fe2887ea4bc1725066dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380ac948-79d2-5acb-95b7-287b34b3a8d8/380ac948-79d2-5acb-95b7-287b34b3a8d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_e633a50ca7ad1b20d754a3a8cb2923f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380ac948-79d2-5acb-95b7-287b34b3a8d8/380ac948-79d2-5acb-95b7-287b34b3a8d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_46895dc0ef8b497fc40908e62f82c846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380ac948-79d2-5acb-95b7-287b34b3a8d8/380ac948-79d2-5acb-95b7-287b34b3a8d8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_8e248592d9e2899260e0615653c7280b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380ac948-79d2-5acb-95b7-287b34b3a8d8/380ac948-79d2-5acb-95b7-287b34b3a8d8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_b970c68edb41147b160fe68ad2a009e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380ac948-79d2-5acb-95b7-287b34b3a8d8/380ac948-79d2-5acb-95b7-287b34b3a8d8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_98c451d5492e68ec206fd834af5357dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380ac948-79d2-5acb-95b7-287b34b3a8d8/380ac948-79d2-5acb-95b7-287b34b3a8d8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_4ae734ed4fdb193dfe6b8661e18b36fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380ac948-79d2-5acb-95b7-287b34b3a8d8/380ac948-79d2-5acb-95b7-287b34b3a8d8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ab/54abac861d9aaf797967f2d9e234d435/pa/AU94213_fec0d7bb930e47ac0440e4c47e3ecded.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2018}
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU94213%27 HTTP/1.1" 200 None
2026-03-27 20:30:37 [auto1.be] INFO: Saving data for AU94213: {'created_time': 1774643437.684602, 'last_price_update_time': 1774643437.684612, 'auction_closing_time': 1774716938.0}
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AU94213') HTTP/1.1" 204 0
2026-03-27 20:30:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item b7aadd58-ffec-5042-90af-62accda44cb4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-27 20:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 19a7a783-c94c-5522-a011-8b1fe04b0d9c with identifier: LN19500
2026-03-27 20:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 19a7a783-c94c-5522-a011-8b1fe04b0d9c with identifier: LN19500
2026-03-27 20:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 19a7a783-c94c-5522-a011-8b1fe04b0d9c with identifier: LN19500 to the API
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:08:45Z',
 'fuel_type': 'petrol',
 'id': '19a7a783-c94c-5522-a011-8b1fe04b0d9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN19500',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 97618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-08',
 'seller_name': None,
 'title': 'Audi A3 40 TFS quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LN19500%27 HTTP/1.1" 200 None
2026-03-27 20:30:37 [auto1.be] INFO: Saving data for LN19500: {'auction_closing_time': 1774714125.0, 'created_time': 1773233588.390061, 'last_price_update_time': 1774643437.971073}
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LN19500') HTTP/1.1" 204 0
2026-03-27 20:30:37 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-27 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-27 20:30:38 [auto1.be] INFO: Scrape type for EL91929: 2
2026-03-27 20:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929
2026-03-27 20:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 078a1d43-c79b-5739-8d43-253a90eb93db with scrape type 2
2026-03-27 20:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 078a1d43-c79b-5739-8d43-253a90eb93db with scrape type 2
2026-03-27 20:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 078a1d43-c79b-5739-8d43-253a90eb93db, identifier: EL91929
2026-03-27 20:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL42374/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929
2026-03-27 20:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929
2026-03-27 20:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929 to the API
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:49:42Z',
 'fuel_type': 'petrol',
 'id': '078a1d43-c79b-5739-8d43-253a90eb93db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL91929',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 96090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2019}
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-27 20:30:38 [auto1.be] INFO: Saving data for EL91929: {'auction_closing_time': 1774716582.0, 'created_time': 1773134160.940849, 'last_price_update_time': 1774643438.371741}
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL91929') HTTP/1.1" 204 0
2026-03-27 20:30:38 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1659 | hits on page: 40
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: KS47676
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: KU28222
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: AY67294
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY67294%27 HTTP/1.1" 200 None
2026-03-27 20:30:38 [auto1.be] INFO: Scrape type for AY67294: 2
2026-03-27 20:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96b436c5-e5c8-5621-9771-966becb9e08d with identifier: AY67294
2026-03-27 20:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96b436c5-e5c8-5621-9771-966becb9e08d with scrape type 2
2026-03-27 20:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96b436c5-e5c8-5621-9771-966becb9e08d with scrape type 2
2026-03-27 20:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96b436c5-e5c8-5621-9771-966becb9e08d, identifier: AY67294
2026-03-27 20:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96b436c5-e5c8-5621-9771-966becb9e08d with identifier: AY67294
2026-03-27 20:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96b436c5-e5c8-5621-9771-966becb9e08d with identifier: AY67294
2026-03-27 20:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96b436c5-e5c8-5621-9771-966becb9e08d with identifier: AY67294 to the API
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:58:27Z',
 'fuel_type': 'diesel',
 'id': '96b436c5-e5c8-5621-9771-966becb9e08d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY67294',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 203302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-27',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY67294%27 HTTP/1.1" 200 None
2026-03-27 20:30:38 [auto1.be] INFO: Saving data for AY67294: {'auction_closing_time': 1774717107.0, 'created_time': 1773238431.449979, 'last_price_update_time': 1774643438.759285}
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AY67294') HTTP/1.1" 204 0
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: EZ92638
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-27 20:30:38 [auto1.be] INFO: Scrape type for SB67636: 0
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: NA16602
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA16602%27 HTTP/1.1" 200 None
2026-03-27 20:30:38 [auto1.be] INFO: Scrape type for NA16602: 0
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: GM68139
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-27 20:30:38 [auto1.be] INFO: Scrape type for YC48670: 2
2026-03-27 20:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670
2026-03-27 20:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with scrape type 2
2026-03-27 20:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with scrape type 2
2026-03-27 20:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7, identifier: YC48670
2026-03-27 20:30:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: LN33262
2026-03-27 20:30:38 [auto1.be] INFO: Found listing with ID: HH92920
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH92920%27 HTTP/1.1" 200 None
2026-03-27 20:30:38 [auto1.be] INFO: Scrape type for HH92920: 2
2026-03-27 20:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f69e175d-6b7f-5d0d-a8c2-36206eb6edd9 with identifier: HH92920
2026-03-27 20:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69e175d-6b7f-5d0d-a8c2-36206eb6edd9 with scrape type 2
2026-03-27 20:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f69e175d-6b7f-5d0d-a8c2-36206eb6edd9 with scrape type 2
2026-03-27 20:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f69e175d-6b7f-5d0d-a8c2-36206eb6edd9, identifier: HH92920
2026-03-27 20:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670
2026-03-27 20:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670
2026-03-27 20:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670 to the API
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:28:41Z',
 'fuel_type': 'diesel',
 'id': 'f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC48670',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60 Cross Country',
 'odometer': 134686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-04',
 'seller_name': None,
 'title': 'Volvo V60 Cross Country 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2015}
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-27 20:30:39 [auto1.be] INFO: Saving data for YC48670: {'auction_closing_time': 1774715321.0, 'created_time': 1773909043.888902, 'last_price_update_time': 1774643439.345167}
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YC48670') HTTP/1.1" 204 0
2026-03-27 20:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f69e175d-6b7f-5d0d-a8c2-36206eb6edd9 with identifier: HH92920
2026-03-27 20:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f69e175d-6b7f-5d0d-a8c2-36206eb6edd9 with identifier: HH92920
2026-03-27 20:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f69e175d-6b7f-5d0d-a8c2-36206eb6edd9 with identifier: HH92920 to the API
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:46:14Z',
 'fuel_type': 'petrol',
 'id': 'f69e175d-6b7f-5d0d-a8c2-36206eb6edd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH92920',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 43625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-24',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH92920%27 HTTP/1.1" 200 None
2026-03-27 20:30:39 [auto1.be] INFO: Saving data for HH92920: {'auction_closing_time': 1774716374.0, 'created_time': 1773136019.844908, 'last_price_update_time': 1774643439.706006}
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH92920') HTTP/1.1" 204 0
2026-03-27 20:30:39 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-27 20:30:39 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-27 20:30:39 [auto1.be] INFO: Scrape type for XB95573: 2
2026-03-27 20:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573
2026-03-27 20:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 470800c9-f629-52c1-80ba-c4a90acbc99f with scrape type 2
2026-03-27 20:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 470800c9-f629-52c1-80ba-c4a90acbc99f with scrape type 2
2026-03-27 20:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 470800c9-f629-52c1-80ba-c4a90acbc99f, identifier: XB95573
2026-03-27 20:30:39 [auto1.be] INFO: Found listing with ID: FD47610
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD47610%27 HTTP/1.1" 200 None
2026-03-27 20:30:39 [auto1.be] INFO: Scrape type for FD47610: 2
2026-03-27 20:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 597ac3fd-df55-5f03-bf6d-3122b3637bd4 with identifier: FD47610
2026-03-27 20:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 597ac3fd-df55-5f03-bf6d-3122b3637bd4 with scrape type 2
2026-03-27 20:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 597ac3fd-df55-5f03-bf6d-3122b3637bd4 with scrape type 2
2026-03-27 20:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 597ac3fd-df55-5f03-bf6d-3122b3637bd4, identifier: FD47610
2026-03-27 20:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573
2026-03-27 20:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573
2026-03-27 20:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573 to the API
2026-03-27 20:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:55:09Z',
 'fuel_type': 'petrol',
 'id': '470800c9-f629-52c1-80ba-c4a90acbc99f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB95573',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 201001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-27 20:30:40 [auto1.be] INFO: Saving data for XB95573: {'auction_closing_time': 1774716909.0, 'created_time': 1773401489.45726, 'last_price_update_time': 1774643440.204183}
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB95573') HTTP/1.1" 204 0
2026-03-27 20:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX88636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 597ac3fd-df55-5f03-bf6d-3122b3637bd4 with identifier: FD47610
2026-03-27 20:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 597ac3fd-df55-5f03-bf6d-3122b3637bd4 with identifier: FD47610
2026-03-27 20:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 597ac3fd-df55-5f03-bf6d-3122b3637bd4 with identifier: FD47610 to the API
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:13:03Z',
 'fuel_type': 'diesel',
 'id': '597ac3fd-df55-5f03-bf6d-3122b3637bd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD47610',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 228932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-11',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD47610%27 HTTP/1.1" 200 None
2026-03-27 20:30:40 [auto1.be] INFO: Saving data for FD47610: {'auction_closing_time': 1774714383.0, 'created_time': 1773236883.39516, 'last_price_update_time': 1774643440.493393}
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FD47610') HTTP/1.1" 204 0
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-27 20:30:40 [auto1.be] INFO: Scrape type for ZB59407: 2
2026-03-27 20:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407
2026-03-27 20:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with scrape type 2
2026-03-27 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with scrape type 2
2026-03-27 20:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3, identifier: ZB59407
2026-03-27 20:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK30308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: YM92505
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM92505%27 HTTP/1.1" 200 None
2026-03-27 20:30:40 [auto1.be] INFO: Scrape type for YM92505: 1
2026-03-27 20:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407
2026-03-27 20:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407
2026-03-27 20:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407 to the API
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:45:47Z',
 'fuel_type': 'petrol',
 'id': '82a3ea25-3305-5fd5-9dfa-25983e9f96f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB59407',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 102886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-11',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 e-THP Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-27 20:30:40 [auto1.be] INFO: Saving data for ZB59407: {'auction_closing_time': 1774716347.0, 'created_time': 1773747683.859757, 'last_price_update_time': 1774643440.887023}
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZB59407') HTTP/1.1" 204 0
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: CW56450
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: UA44926
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: XU56519
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU56519%27 HTTP/1.1" 200 None
2026-03-27 20:30:40 [auto1.be] INFO: Scrape type for XU56519: 0
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: EP21632
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP21632%27 HTTP/1.1" 200 None
2026-03-27 20:30:40 [auto1.be] INFO: Scrape type for EP21632: 0
2026-03-27 20:30:40 [auto1.be] INFO: Found listing with ID: JE64072
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE64072%27 HTTP/1.1" 200 None
2026-03-27 20:30:40 [auto1.be] INFO: Scrape type for JE64072: 2
2026-03-27 20:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46123084-4194-5fd5-9ed8-fd8cf5431981 with identifier: JE64072
2026-03-27 20:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46123084-4194-5fd5-9ed8-fd8cf5431981 with scrape type 2
2026-03-27 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46123084-4194-5fd5-9ed8-fd8cf5431981 with scrape type 2
2026-03-27 20:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46123084-4194-5fd5-9ed8-fd8cf5431981, identifier: JE64072
2026-03-27 20:30:41 [auto1.be] INFO: Found listing with ID: YA41293
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA41293%27 HTTP/1.1" 200 None
2026-03-27 20:30:41 [auto1.be] INFO: Scrape type for YA41293: 2
2026-03-27 20:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da5b65a9-7c71-5a92-88b2-2286d68afd1f with identifier: YA41293
2026-03-27 20:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5b65a9-7c71-5a92-88b2-2286d68afd1f with scrape type 2
2026-03-27 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da5b65a9-7c71-5a92-88b2-2286d68afd1f with scrape type 2
2026-03-27 20:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: da5b65a9-7c71-5a92-88b2-2286d68afd1f, identifier: YA41293
2026-03-27 20:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46123084-4194-5fd5-9ed8-fd8cf5431981 with identifier: JE64072
2026-03-27 20:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46123084-4194-5fd5-9ed8-fd8cf5431981 with identifier: JE64072
2026-03-27 20:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46123084-4194-5fd5-9ed8-fd8cf5431981 with identifier: JE64072 to the API
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:52:38Z',
 'fuel_type': 'petrol',
 'id': '46123084-4194-5fd5-9ed8-fd8cf5431981',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE64072',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 169625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-14',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE64072%27 HTTP/1.1" 200 None
2026-03-27 20:30:41 [auto1.be] INFO: Saving data for JE64072: {'auction_closing_time': 1774716758.0, 'created_time': 1774438290.748037, 'last_price_update_time': 1774643441.412978}
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JE64072') HTTP/1.1" 204 0
2026-03-27 20:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: da5b65a9-7c71-5a92-88b2-2286d68afd1f with identifier: YA41293
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-27 20:30:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: da5b65a9-7c71-5a92-88b2-2286d68afd1f with identifier: YA41293
2026-03-27 20:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: da5b65a9-7c71-5a92-88b2-2286d68afd1f with identifier: YA41293 to the API
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:37:15Z',
 'fuel_type': 'diesel',
 'id': 'da5b65a9-7c71-5a92-88b2-2286d68afd1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA41293',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Aircross',
 'odometer': 112482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-18',
 'seller_name': None,
 'title': 'Citroen C4 Aircross 1.6 HDi Tendance 2WD',
 'transmission': 'manual',
 'trim': 'Tendance 2WD',
 'year': 2012}
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA41293%27 HTTP/1.1" 200 None
2026-03-27 20:30:41 [auto1.be] INFO: Saving data for YA41293: {'auction_closing_time': 1774715835.0, 'created_time': 1773237124.881788, 'last_price_update_time': 1774643441.893978}
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA41293') HTTP/1.1" 204 0
2026-03-27 20:30:41 [auto1.be] INFO: Found listing with ID: AW18524
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW18524%27 HTTP/1.1" 200 None
2026-03-27 20:30:41 [auto1.be] INFO: Scrape type for AW18524: 2
2026-03-27 20:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da763fc4-659c-5a43-b286-a2ff9505c312 with identifier: AW18524
2026-03-27 20:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da763fc4-659c-5a43-b286-a2ff9505c312 with scrape type 2
2026-03-27 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da763fc4-659c-5a43-b286-a2ff9505c312 with scrape type 2
2026-03-27 20:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: da763fc4-659c-5a43-b286-a2ff9505c312, identifier: AW18524
2026-03-27 20:30:42 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-27 20:30:42 [auto1.be] INFO: Scrape type for ZS70359: 2
2026-03-27 20:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359
2026-03-27 20:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b7af419-f1a7-5722-b52a-c9af478eeab2 with scrape type 2
2026-03-27 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b7af419-f1a7-5722-b52a-c9af478eeab2 with scrape type 2
2026-03-27 20:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b7af419-f1a7-5722-b52a-c9af478eeab2, identifier: ZS70359
2026-03-27 20:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: da763fc4-659c-5a43-b286-a2ff9505c312 with identifier: AW18524
2026-03-27 20:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: da763fc4-659c-5a43-b286-a2ff9505c312 with identifier: AW18524
2026-03-27 20:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: da763fc4-659c-5a43-b286-a2ff9505c312 with identifier: AW18524 to the API
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:50:18Z',
 'fuel_type': 'diesel',
 'id': 'da763fc4-659c-5a43-b286-a2ff9505c312',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW18524',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 207458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'T BlueTEC AMG Line',
 'year': 2015}
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW18524%27 HTTP/1.1" 200 None
2026-03-27 20:30:42 [auto1.be] INFO: Saving data for AW18524: {'auction_closing_time': 1774716618.0, 'created_time': 1774438255.919535, 'last_price_update_time': 1774643442.428896}
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AW18524') HTTP/1.1" 204 0
2026-03-27 20:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359
2026-03-27 20:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359
2026-03-27 20:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359 to the API
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:57:06Z',
 'fuel_type': 'diesel',
 'id': '1b7af419-f1a7-5722-b52a-c9af478eeab2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS70359',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 94593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Premium AWD',
 'transmission': 'automatic',
 'trim': 'Premium AWD',
 'year': 2016}
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-27 20:30:42 [auto1.be] INFO: Saving data for ZS70359: {'auction_closing_time': 1774717026.0, 'created_time': 1773779669.073823, 'last_price_update_time': 1774643442.720636}
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZS70359') HTTP/1.1" 204 0
2026-03-27 20:30:42 [auto1.be] INFO: Found listing with ID: PD31186
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD31186%27 HTTP/1.1" 200 None
2026-03-27 20:30:42 [auto1.be] INFO: Scrape type for PD31186: 2
2026-03-27 20:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2fe092f-fdfa-5fe4-9349-b9cbe94df4f9 with identifier: PD31186
2026-03-27 20:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2fe092f-fdfa-5fe4-9349-b9cbe94df4f9 with scrape type 2
2026-03-27 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2fe092f-fdfa-5fe4-9349-b9cbe94df4f9 with scrape type 2
2026-03-27 20:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2fe092f-fdfa-5fe4-9349-b9cbe94df4f9, identifier: PD31186
2026-03-27 20:30:42 [auto1.be] INFO: Found listing with ID: WX65816
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX65816%27 HTTP/1.1" 200 None
2026-03-27 20:30:42 [auto1.be] INFO: Scrape type for WX65816: 2
2026-03-27 20:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3005cb31-4243-5517-acca-735000fdf247 with identifier: WX65816
2026-03-27 20:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3005cb31-4243-5517-acca-735000fdf247 with scrape type 2
2026-03-27 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3005cb31-4243-5517-acca-735000fdf247 with scrape type 2
2026-03-27 20:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3005cb31-4243-5517-acca-735000fdf247, identifier: WX65816
2026-03-27 20:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2fe092f-fdfa-5fe4-9349-b9cbe94df4f9 with identifier: PD31186
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-27 20:30:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2fe092f-fdfa-5fe4-9349-b9cbe94df4f9 with identifier: PD31186
2026-03-27 20:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2fe092f-fdfa-5fe4-9349-b9cbe94df4f9 with identifier: PD31186 to the API
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:44:46Z',
 'fuel_type': 'gas',
 'id': 'e2fe092f-fdfa-5fe4-9349-b9cbe94df4f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD31186',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 199738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI g-tron',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD31186%27 HTTP/1.1" 200 None
2026-03-27 20:30:43 [auto1.be] INFO: Saving data for PD31186: {'auction_closing_time': 1774716286.0, 'created_time': 1774438225.335646, 'last_price_update_time': 1774643443.324763}
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PD31186') HTTP/1.1" 204 0
2026-03-27 20:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3005cb31-4243-5517-acca-735000fdf247 with identifier: WX65816
2026-03-27 20:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3005cb31-4243-5517-acca-735000fdf247 with identifier: WX65816
2026-03-27 20:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3005cb31-4243-5517-acca-735000fdf247 with identifier: WX65816 to the API
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:50Z',
 'fuel_type': 'petrol',
 'id': '3005cb31-4243-5517-acca-735000fdf247',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX65816',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 143369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-19',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.4 TSI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2018}
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX65816%27 HTTP/1.1" 200 None
2026-03-27 20:30:43 [auto1.be] INFO: Saving data for WX65816: {'auction_closing_time': 1774715030.0, 'created_time': 1773132038.299881, 'last_price_update_time': 1774643443.634814}
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WX65816') HTTP/1.1" 204 0
2026-03-27 20:30:43 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-27 20:30:43 [auto1.be] INFO: Found listing with ID: NS20906
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS20906%27 HTTP/1.1" 200 None
2026-03-27 20:30:43 [auto1.be] INFO: Scrape type for NS20906: 2
2026-03-27 20:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5af18e1-f0e7-5013-98a8-b74c38c348b2 with identifier: NS20906
2026-03-27 20:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5af18e1-f0e7-5013-98a8-b74c38c348b2 with scrape type 2
2026-03-27 20:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5af18e1-f0e7-5013-98a8-b74c38c348b2 with scrape type 2
2026-03-27 20:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a5af18e1-f0e7-5013-98a8-b74c38c348b2, identifier: NS20906
2026-03-27 20:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB83669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:43 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-27 20:30:43 [auto1.be] INFO: Scrape type for PR31064: 2
2026-03-27 20:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064
2026-03-27 20:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with scrape type 2
2026-03-27 20:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with scrape type 2
2026-03-27 20:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b736c1b1-d83d-5a21-a86f-e1d912abd4a3, identifier: PR31064
2026-03-27 20:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a5af18e1-f0e7-5013-98a8-b74c38c348b2 with identifier: NS20906
2026-03-27 20:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a5af18e1-f0e7-5013-98a8-b74c38c348b2 with identifier: NS20906
2026-03-27 20:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a5af18e1-f0e7-5013-98a8-b74c38c348b2 with identifier: NS20906 to the API
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:42:53Z',
 'fuel_type': 'diesel',
 'id': 'a5af18e1-f0e7-5013-98a8-b74c38c348b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS20906',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 188688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS20906%27 HTTP/1.1" 200 None
2026-03-27 20:30:44 [auto1.be] INFO: Saving data for NS20906: {'auction_closing_time': 1774716173.0, 'created_time': 1774438253.646634, 'last_price_update_time': 1774643444.229327}
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NS20906') HTTP/1.1" 204 0
2026-03-27 20:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064
2026-03-27 20:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064
2026-03-27 20:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064 to the API
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:14:46Z',
 'fuel_type': 'diesel',
 'id': 'b736c1b1-d83d-5a21-a86f-e1d912abd4a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR31064',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 148947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-04',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-27 20:30:44 [auto1.be] INFO: Saving data for PR31064: {'auction_closing_time': 1774714486.0, 'created_time': 1773865879.429227, 'last_price_update_time': 1774643444.549153}
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR31064') HTTP/1.1" 204 0
2026-03-27 20:30:44 [auto1.be] INFO: Found listing with ID: PJ37303
2026-03-27 20:30:44 [auto1.be] INFO: Found listing with ID: VS66255
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS66255%27 HTTP/1.1" 200 None
2026-03-27 20:30:44 [auto1.be] INFO: Scrape type for VS66255: 0
2026-03-27 20:30:44 [auto1.be] INFO: Found listing with ID: FZ96232
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ96232%27 HTTP/1.1" 200 None
2026-03-27 20:30:44 [auto1.be] INFO: Scrape type for FZ96232: 0
2026-03-27 20:30:44 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-27 20:30:44 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-27 20:30:44 [auto1.be] INFO: Scrape type for RL24593: 0
2026-03-27 20:30:44 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-27 20:30:44 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ61714%27 HTTP/1.1" 200 None
2026-03-27 20:30:44 [auto1.be] INFO: Scrape type for HJ61714: 2
2026-03-27 20:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6ee21ef-849b-5011-995d-887acf6eacc2 with identifier: HJ61714
2026-03-27 20:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6ee21ef-849b-5011-995d-887acf6eacc2 with scrape type 2
2026-03-27 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6ee21ef-849b-5011-995d-887acf6eacc2 with scrape type 2
2026-03-27 20:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6ee21ef-849b-5011-995d-887acf6eacc2, identifier: HJ61714
2026-03-27 20:30:44 [auto1.be] INFO: Found listing with ID: YR74794
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR74794%27 HTTP/1.1" 200 None
2026-03-27 20:30:44 [auto1.be] INFO: Scrape type for YR74794: 2
2026-03-27 20:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f70f59-0a38-58d8-a518-fc553dcbebb2 with identifier: YR74794
2026-03-27 20:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f70f59-0a38-58d8-a518-fc553dcbebb2 with scrape type 2
2026-03-27 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43f70f59-0a38-58d8-a518-fc553dcbebb2 with scrape type 2
2026-03-27 20:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43f70f59-0a38-58d8-a518-fc553dcbebb2, identifier: YR74794
2026-03-27 20:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6ee21ef-849b-5011-995d-887acf6eacc2 with identifier: HJ61714
2026-03-27 20:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6ee21ef-849b-5011-995d-887acf6eacc2 with identifier: HJ61714
2026-03-27 20:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6ee21ef-849b-5011-995d-887acf6eacc2 with identifier: HJ61714 to the API
2026-03-27 20:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:07:20Z',
 'fuel_type': 'petrol',
 'id': 'c6ee21ef-849b-5011-995d-887acf6eacc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ61714',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 191306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-08',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI Carat',
 'transmission': 'automatic',
 'trim': 'Carat',
 'year': 2009}
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ61714%27 HTTP/1.1" 200 None
2026-03-27 20:30:45 [auto1.be] INFO: Saving data for HJ61714: {'auction_closing_time': 1774714040.0, 'created_time': 1773693937.188168, 'last_price_update_time': 1774643445.170688}
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ61714') HTTP/1.1" 204 0
2026-03-27 20:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43f70f59-0a38-58d8-a518-fc553dcbebb2 with identifier: YR74794
2026-03-27 20:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43f70f59-0a38-58d8-a518-fc553dcbebb2 with identifier: YR74794
2026-03-27 20:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43f70f59-0a38-58d8-a518-fc553dcbebb2 with identifier: YR74794 to the API
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:16:10Z',
 'fuel_type': 'petrol',
 'id': '43f70f59-0a38-58d8-a518-fc553dcbebb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR74794',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 126580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-24',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR74794%27 HTTP/1.1" 200 None
2026-03-27 20:30:45 [auto1.be] INFO: Saving data for YR74794: {'auction_closing_time': 1774714570.0, 'created_time': 1773133040.857679, 'last_price_update_time': 1774643445.552306}
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YR74794') HTTP/1.1" 204 0
2026-03-27 20:30:45 [auto1.be] INFO: Found listing with ID: ZJ09914
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ09914%27 HTTP/1.1" 200 None
2026-03-27 20:30:45 [auto1.be] INFO: Scrape type for ZJ09914: 0
2026-03-27 20:30:45 [auto1.be] INFO: Found listing with ID: ZL48181
2026-03-27 20:30:45 [auto1.be] INFO: Found listing with ID: WS64524
2026-03-27 20:30:45 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-27 20:30:45 [auto1.be] INFO: Scrape type for UR44884: 0
2026-03-27 20:30:45 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-27 20:30:45 [auto1.be] INFO: Found listing with ID: XC85996
2026-03-27 20:30:45 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-27 20:30:45 [auto1.be] INFO: Scrape type for LL08256: 2
2026-03-27 20:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256
2026-03-27 20:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 605abb47-5ccc-5d98-954c-37d2779ff39e with scrape type 2
2026-03-27 20:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 605abb47-5ccc-5d98-954c-37d2779ff39e with scrape type 2
2026-03-27 20:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 605abb47-5ccc-5d98-954c-37d2779ff39e, identifier: LL08256
2026-03-27 20:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256
2026-03-27 20:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256
2026-03-27 20:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256 to the API
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:33:02Z',
 'fuel_type': 'petrol',
 'id': '605abb47-5ccc-5d98-954c-37d2779ff39e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL08256',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 105113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-27 20:30:46 [auto1.be] INFO: Saving data for LL08256: {'auction_closing_time': 1774715582.0, 'created_time': 1773236772.964812, 'last_price_update_time': 1774643446.038746}
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LL08256') HTTP/1.1" 204 0
2026-03-27 20:30:46 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1659 | hits on page: 40
2026-03-27 20:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-27 20:30:46 [auto1.be] INFO: Scrape type for FL46625: 2
2026-03-27 20:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625
2026-03-27 20:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bd949b-b83e-529a-9f2a-bacf018aaace with scrape type 2
2026-03-27 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4bd949b-b83e-529a-9f2a-bacf018aaace with scrape type 2
2026-03-27 20:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4bd949b-b83e-529a-9f2a-bacf018aaace, identifier: FL46625
2026-03-27 20:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625
2026-03-27 20:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625
2026-03-27 20:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625 to the API
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:36:53Z',
 'fuel_type': 'diesel',
 'id': 'e4bd949b-b83e-529a-9f2a-bacf018aaace',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL46625',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 176922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-16',
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-27 20:30:46 [auto1.be] INFO: Saving data for FL46625: {'auction_closing_time': 1774715813.0, 'created_time': 1773909417.812952, 'last_price_update_time': 1774643446.436849}
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FL46625') HTTP/1.1" 204 0
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: DX33442
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX33442%27 HTTP/1.1" 200 None
2026-03-27 20:30:46 [auto1.be] INFO: Scrape type for DX33442: 0
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: CC60514
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC60514%27 HTTP/1.1" 200 None
2026-03-27 20:30:46 [auto1.be] INFO: Scrape type for CC60514: 0
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: BP07679
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP07679%27 HTTP/1.1" 200 None
2026-03-27 20:30:46 [auto1.be] INFO: Scrape type for BP07679: 2
2026-03-27 20:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 744bef4f-fe3f-56aa-9658-61d3f09c9824 with identifier: BP07679
2026-03-27 20:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 744bef4f-fe3f-56aa-9658-61d3f09c9824 with scrape type 2
2026-03-27 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 744bef4f-fe3f-56aa-9658-61d3f09c9824 with scrape type 2
2026-03-27 20:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 744bef4f-fe3f-56aa-9658-61d3f09c9824, identifier: BP07679
2026-03-27 20:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-27 20:30:46 [auto1.be] INFO: Scrape type for BT72678: 0
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-27 20:30:46 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-27 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-27 20:30:47 [auto1.be] INFO: Scrape type for CE58685: 2
2026-03-27 20:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685
2026-03-27 20:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with scrape type 2
2026-03-27 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with scrape type 2
2026-03-27 20:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eb2f681d-d203-57e2-8f7d-18af5a0d45c2, identifier: CE58685
2026-03-27 20:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 744bef4f-fe3f-56aa-9658-61d3f09c9824 with identifier: BP07679
2026-03-27 20:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 744bef4f-fe3f-56aa-9658-61d3f09c9824 with identifier: BP07679
2026-03-27 20:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 744bef4f-fe3f-56aa-9658-61d3f09c9824 with identifier: BP07679 to the API
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:16:04Z',
 'fuel_type': 'diesel',
 'id': '744bef4f-fe3f-56aa-9658-61d3f09c9824',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP07679',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 134520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-10',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP07679%27 HTTP/1.1" 200 None
2026-03-27 20:30:47 [auto1.be] INFO: Saving data for BP07679: {'auction_closing_time': 1774714564.0, 'created_time': 1774438278.622062, 'last_price_update_time': 1774643447.401935}
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BP07679') HTTP/1.1" 204 0
2026-03-27 20:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685
2026-03-27 20:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685
2026-03-27 20:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685 to the API
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:19:29Z',
 'fuel_type': 'petrol',
 'id': 'eb2f681d-d203-57e2-8f7d-18af5a0d45c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE58685',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 153262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-18',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Racer',
 'transmission': 'manual',
 'trim': 'Racer',
 'year': 2016}
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-27 20:30:47 [auto1.be] INFO: Saving data for CE58685: {'auction_closing_time': 1774714769.0, 'created_time': 1773434068.87953, 'last_price_update_time': 1774643447.984836}
2026-03-27 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE58685') HTTP/1.1" 204 0
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ84732%27 HTTP/1.1" 200 None
2026-03-27 20:30:48 [auto1.be] INFO: Scrape type for BJ84732: 0
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: ZY53321
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-27 20:30:48 [auto1.be] INFO: Scrape type for TH79553: 0
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: AN14983
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: KY60433
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: HF70171
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF70171%27 HTTP/1.1" 200 None
2026-03-27 20:30:48 [auto1.be] INFO: Scrape type for HF70171: 0
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: CS11712
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS11712%27 HTTP/1.1" 200 None
2026-03-27 20:30:48 [auto1.be] INFO: Scrape type for CS11712: 0
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: NY90859
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY90859%27 HTTP/1.1" 200 None
2026-03-27 20:30:48 [auto1.be] INFO: Scrape type for NY90859: 0
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-27 20:30:48 [auto1.be] INFO: Scrape type for WA78577: 0
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: YV88346
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: SX76756
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-27 20:30:48 [auto1.be] INFO: Scrape type for ZJ26609: 0
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU54459%27 HTTP/1.1" 200 None
2026-03-27 20:30:48 [auto1.be] INFO: Scrape type for YU54459: 0
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: UN79459
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: RD83049
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: UE64261
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: UA02413
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-27 20:30:48 [auto1.be] INFO: Scrape type for YW15851: 2
2026-03-27 20:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851
2026-03-27 20:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with scrape type 2
2026-03-27 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with scrape type 2
2026-03-27 20:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac, identifier: YW15851
2026-03-27 20:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM92505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-27 20:30:48 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-27 20:30:48 [auto1.be] INFO: Scrape type for ND78338: 2
2026-03-27 20:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338
2026-03-27 20:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcfde79d-7732-504a-936f-78c7d505981f with scrape type 2
2026-03-27 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcfde79d-7732-504a-936f-78c7d505981f with scrape type 2
2026-03-27 20:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bcfde79d-7732-504a-936f-78c7d505981f, identifier: ND78338
2026-03-27 20:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851
2026-03-27 20:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851
2026-03-27 20:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851 to the API
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:31:56Z',
 'fuel_type': 'diesel',
 'id': '3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW15851',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 97288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-14',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.0 Blue-HDi 335 L3 BlueHDi 130 Cargo Edition mit '
          'Ladebordwand',
 'transmission': 'manual',
 'trim': '335 L3 BlueHDi 130 Cargo Edition mit Ladebordwand',
 'year': 2017}
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-27 20:30:48 [auto1.be] INFO: Saving data for YW15851: {'auction_closing_time': 1774715516.0, 'created_time': 1774557039.454165, 'last_price_update_time': 1774643448.733624}
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW15851') HTTP/1.1" 204 0
2026-03-27 20:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338
2026-03-27 20:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338
2026-03-27 20:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338 to the API
2026-03-27 20:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:48:01Z',
 'fuel_type': 'hybrid',
 'id': 'bcfde79d-7732-504a-936f-78c7d505981f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND78338',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 173793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-12',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2017}
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-27 20:30:49 [auto1.be] INFO: Saving data for ND78338: {'auction_closing_time': 1774716481.0, 'created_time': 1773693902.331347, 'last_price_update_time': 1774643449.097174}
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ND78338') HTTP/1.1" 204 0
2026-03-27 20:30:49 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-27 20:30:49 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-27 20:30:49 [auto1.be] INFO: Found listing with ID: FW97507
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW97507%27 HTTP/1.1" 200 None
2026-03-27 20:30:49 [auto1.be] INFO: Scrape type for FW97507: 2
2026-03-27 20:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: addef0e5-c51f-5ca7-aa4b-2bffa158e6bf with identifier: FW97507
2026-03-27 20:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item addef0e5-c51f-5ca7-aa4b-2bffa158e6bf with scrape type 2
2026-03-27 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item addef0e5-c51f-5ca7-aa4b-2bffa158e6bf with scrape type 2
2026-03-27 20:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: addef0e5-c51f-5ca7-aa4b-2bffa158e6bf, identifier: FW97507
2026-03-27 20:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: addef0e5-c51f-5ca7-aa4b-2bffa158e6bf with identifier: FW97507
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-27 20:30:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: addef0e5-c51f-5ca7-aa4b-2bffa158e6bf with identifier: FW97507
2026-03-27 20:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: addef0e5-c51f-5ca7-aa4b-2bffa158e6bf with identifier: FW97507 to the API
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:21:31Z',
 'fuel_type': 'diesel',
 'id': 'addef0e5-c51f-5ca7-aa4b-2bffa158e6bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW97507',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 185585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-19',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten-Hochdach lang',
 'transmission': 'manual',
 'trim': 'Kasten-Hochdach lang',
 'year': 2010}
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW97507%27 HTTP/1.1" 200 None
2026-03-27 20:30:49 [auto1.be] INFO: Saving data for FW97507: {'auction_closing_time': 1774714891.0, 'created_time': 1774438282.125753, 'last_price_update_time': 1774643449.654419}
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FW97507') HTTP/1.1" 204 0
2026-03-27 20:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX88636> (referer: https://www.auto1.com/v1/car-details-view/XX88636/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK30308> (referer: https://www.auto1.com/v1/car-details-view/MK30308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:49 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-27 20:30:49 [auto1.be] INFO: Scrape type for VM06685: 0
2026-03-27 20:30:49 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV48703%27 HTTP/1.1" 200 None
2026-03-27 20:30:49 [auto1.be] INFO: Scrape type for BV48703: 2
2026-03-27 20:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4d94062-0400-5bc4-9cbc-b095a24f6211 with identifier: BV48703
2026-03-27 20:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4d94062-0400-5bc4-9cbc-b095a24f6211 with scrape type 2
2026-03-27 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4d94062-0400-5bc4-9cbc-b095a24f6211 with scrape type 2
2026-03-27 20:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4d94062-0400-5bc4-9cbc-b095a24f6211, identifier: BV48703
2026-03-27 20:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4d94062-0400-5bc4-9cbc-b095a24f6211 with identifier: BV48703
2026-03-27 20:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4d94062-0400-5bc4-9cbc-b095a24f6211 with identifier: BV48703
2026-03-27 20:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4d94062-0400-5bc4-9cbc-b095a24f6211 with identifier: BV48703 to the API
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:05:12Z',
 'fuel_type': 'diesel',
 'id': 'b4d94062-0400-5bc4-9cbc-b095a24f6211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV48703',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 237500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2015}
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV48703%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [auto1.be] INFO: Saving data for BV48703: {'auction_closing_time': 1774713912.0, 'created_time': 1773136197.192018, 'last_price_update_time': 1774643450.063864}
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV48703') HTTP/1.1" 204 0
2026-03-27 20:30:50 [auto1.be] INFO: Found listing with ID: GR59169
2026-03-27 20:30:50 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [auto1.be] INFO: Scrape type for AP73624: 0
2026-03-27 20:30:50 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-27 20:30:50 [auto1.be] INFO: Found listing with ID: EU62289
2026-03-27 20:30:50 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-27 20:30:50 [auto1.be] INFO: Found listing with ID: CD49424
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD49424%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [auto1.be] INFO: Scrape type for CD49424: 0
2026-03-27 20:30:50 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [auto1.be] INFO: Scrape type for TK06008: 0
2026-03-27 20:30:50 [auto1.be] INFO: Found listing with ID: UY34389
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY34389%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [auto1.be] INFO: Scrape type for UY34389: 0
2026-03-27 20:30:50 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE19111%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [auto1.be] INFO: Scrape type for HE19111: 2
2026-03-27 20:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12603997-a459-5057-9b27-a7d3c7aeeb8a with identifier: HE19111
2026-03-27 20:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12603997-a459-5057-9b27-a7d3c7aeeb8a with scrape type 2
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12603997-a459-5057-9b27-a7d3c7aeeb8a with scrape type 2
2026-03-27 20:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12603997-a459-5057-9b27-a7d3c7aeeb8a, identifier: HE19111
2026-03-27 20:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12603997-a459-5057-9b27-a7d3c7aeeb8a with identifier: HE19111
2026-03-27 20:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12603997-a459-5057-9b27-a7d3c7aeeb8a with identifier: HE19111
2026-03-27 20:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12603997-a459-5057-9b27-a7d3c7aeeb8a with identifier: HE19111 to the API
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:39:40Z',
 'fuel_type': 'petrol',
 'id': '12603997-a459-5057-9b27-a7d3c7aeeb8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE19111',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 107066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-23',
 'seller_name': None,
 'title': 'BMW 3er 320i EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2013}
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE19111%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [auto1.be] INFO: Saving data for HE19111: {'auction_closing_time': 1774715980.0, 'created_time': 1773134622.131033, 'last_price_update_time': 1774643450.522615}
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HE19111') HTTP/1.1" 204 0
2026-03-27 20:30:50 [auto1.be] INFO: Found listing with ID: CB83529
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB83529%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [auto1.be] INFO: Scrape type for CB83529: 0
2026-03-27 20:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d3017f-15f6-5665-8d32-7b21ba1ee941 with identifier: XX88636
2026-03-27 20:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87d3017f-15f6-5665-8d32-7b21ba1ee941 with scrape type 1
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87d3017f-15f6-5665-8d32-7b21ba1ee941
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fc5%252F91c51d0662e2e0afffdb7b42cc2c1a6c%252Fpa%252FXX88636_02cbb307253eb59b904c16d8b1816613.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_02cbb307253eb59b904c16d8b1816613.jpg already downloaded
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fc5%252F91c51d0662e2e0afffdb7b42cc2c1a6c%252Fpa%252FXX88636_95d2ff413e0365495acc536e42dac7b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_95d2ff413e0365495acc536e42dac7b4.jpg already downloaded
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fc5%252F91c51d0662e2e0afffdb7b42cc2c1a6c%252Fpa%252FXX88636_2db2d195e0135a7167d3471d7839c833.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_2db2d195e0135a7167d3471d7839c833.jpg already downloaded
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fc5%252F91c51d0662e2e0afffdb7b42cc2c1a6c%252Fpa%252FXX88636_94a04e67eb430e870c8d2e7fbc9d56a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_94a04e67eb430e870c8d2e7fbc9d56a1.jpg already downloaded
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fc5%252F91c51d0662e2e0afffdb7b42cc2c1a6c%252Fpa%252FXX88636_20f2cb7e82d1b422f29f379929bc8197.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_20f2cb7e82d1b422f29f379929bc8197.jpg already downloaded
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fc5%252F91c51d0662e2e0afffdb7b42cc2c1a6c%252Fpa%252FXX88636_e77e644ae123e78efce85124f4474451.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_e77e644ae123e78efce85124f4474451.jpg already downloaded
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fc5%252F91c51d0662e2e0afffdb7b42cc2c1a6c%252Fpa%252FXX88636_e9f98198850d50ce43bb3154cd664556.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_e9f98198850d50ce43bb3154cd664556.jpg already downloaded
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fc5%252F91c51d0662e2e0afffdb7b42cc2c1a6c%252Fpa%252FXX88636_76734a70385123e00a7bddc5346f8eb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_76734a70385123e00a7bddc5346f8eb1.jpg already downloaded
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fc5%252F91c51d0662e2e0afffdb7b42cc2c1a6c%252Fpa%252FXX88636_1d3e09cfbae7b70598663c126c86daf6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_1d3e09cfbae7b70598663c126c86daf6.jpg already downloaded
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fc5%252F91c51d0662e2e0afffdb7b42cc2c1a6c%252Fpa%252FXX88636_9e070e49bbaa40402717e7ae2acc52d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_9e070e49bbaa40402717e7ae2acc52d8.jpg already downloaded
2026-03-27 20:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 87d3017f-15f6-5665-8d32-7b21ba1ee941, identifier: XX88636
2026-03-27 20:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308
2026-03-27 20:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a64476-33bd-5625-b0bf-97078fff89b2 with scrape type 1
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65a64476-33bd-5625-b0bf-97078fff89b2
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fba%252F4aba8bc17af73d9cc2cc6bd455d9f7da%252Fpa%252FMK30308_815ecccb159e482c02ccfd0e7470b23d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_815ecccb159e482c02ccfd0e7470b23d.jpg already downloaded
2026-03-27 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fba%252F4aba8bc17af73d9cc2cc6bd455d9f7da%252Fpa%252FMK30308_2b5a26efcd0c88bb9cd5699d6634c2f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_2b5a26efcd0c88bb9cd5699d6634c2f8.jpg already downloaded
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fba%252F4aba8bc17af73d9cc2cc6bd455d9f7da%252Fpa%252FMK30308_b81388c83a1bbc55ef7b4dea7fc85279.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_b81388c83a1bbc55ef7b4dea7fc85279.jpg already downloaded
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fba%252F4aba8bc17af73d9cc2cc6bd455d9f7da%252Fpa%252FMK30308_afd66bb666734621aa8169d7dd762cb5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_afd66bb666734621aa8169d7dd762cb5.jpg already downloaded
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fba%252F4aba8bc17af73d9cc2cc6bd455d9f7da%252Fpa%252FMK30308_2383395affd0487d9eeda51f73af3692.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_2383395affd0487d9eeda51f73af3692.jpg already downloaded
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fba%252F4aba8bc17af73d9cc2cc6bd455d9f7da%252Fpa%252FMK30308_215b9e5e8437b782d44cebed02f95095.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_215b9e5e8437b782d44cebed02f95095.jpg already downloaded
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fba%252F4aba8bc17af73d9cc2cc6bd455d9f7da%252Fpa%252FMK30308_485e6b88f0c78a26602f4b7851dde3ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_485e6b88f0c78a26602f4b7851dde3ef.jpg already downloaded
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fba%252F4aba8bc17af73d9cc2cc6bd455d9f7da%252Fpa%252FMK30308_f97a18b82f1a9ccb4e589609313dd9e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_f97a18b82f1a9ccb4e589609313dd9e1.jpg already downloaded
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fba%252F4aba8bc17af73d9cc2cc6bd455d9f7da%252Fpa%252FMK30308_0f6942eba68fa81540405d0c1719758d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_0f6942eba68fa81540405d0c1719758d.jpg already downloaded
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fba%252F4aba8bc17af73d9cc2cc6bd455d9f7da%252Fpa%252FMK30308_6bb47d3ca57d3559544540e8fcb33a25.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_6bb47d3ca57d3559544540e8fcb33a25.jpg already downloaded
2026-03-27 20:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 65a64476-33bd-5625-b0bf-97078fff89b2, identifier: MK30308
2026-03-27 20:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 87d3017f-15f6-5665-8d32-7b21ba1ee941 with identifier: XX88636
2026-03-27 20:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 87d3017f-15f6-5665-8d32-7b21ba1ee941 with identifier: XX88636
2026-03-27 20:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 87d3017f-15f6-5665-8d32-7b21ba1ee941 with identifier: XX88636 to the API
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XX88636>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:06:22Z',
 'fuel_type': 'diesel',
 'id': '87d3017f-15f6-5665-8d32-7b21ba1ee941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX88636',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 125521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_02cbb307253eb59b904c16d8b1816613.jpg',
                'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_95d2ff413e0365495acc536e42dac7b4.jpg',
                'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_2db2d195e0135a7167d3471d7839c833.jpg',
                'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_94a04e67eb430e870c8d2e7fbc9d56a1.jpg',
                'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_20f2cb7e82d1b422f29f379929bc8197.jpg',
                'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_e77e644ae123e78efce85124f4474451.jpg',
                'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_e9f98198850d50ce43bb3154cd664556.jpg',
                'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_76734a70385123e00a7bddc5346f8eb1.jpg',
                'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_1d3e09cfbae7b70598663c126c86daf6.jpg',
                'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_9e070e49bbaa40402717e7ae2acc52d8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d3017f-15f6-5665-8d32-7b21ba1ee941/87d3017f-15f6-5665-8d32-7b21ba1ee941_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_02cbb307253eb59b904c16d8b1816613.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d3017f-15f6-5665-8d32-7b21ba1ee941/87d3017f-15f6-5665-8d32-7b21ba1ee941_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_95d2ff413e0365495acc536e42dac7b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d3017f-15f6-5665-8d32-7b21ba1ee941/87d3017f-15f6-5665-8d32-7b21ba1ee941_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_2db2d195e0135a7167d3471d7839c833.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d3017f-15f6-5665-8d32-7b21ba1ee941/87d3017f-15f6-5665-8d32-7b21ba1ee941_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_94a04e67eb430e870c8d2e7fbc9d56a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d3017f-15f6-5665-8d32-7b21ba1ee941/87d3017f-15f6-5665-8d32-7b21ba1ee941_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_20f2cb7e82d1b422f29f379929bc8197.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d3017f-15f6-5665-8d32-7b21ba1ee941/87d3017f-15f6-5665-8d32-7b21ba1ee941_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_e77e644ae123e78efce85124f4474451.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d3017f-15f6-5665-8d32-7b21ba1ee941/87d3017f-15f6-5665-8d32-7b21ba1ee941_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_e9f98198850d50ce43bb3154cd664556.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d3017f-15f6-5665-8d32-7b21ba1ee941/87d3017f-15f6-5665-8d32-7b21ba1ee941_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_76734a70385123e00a7bddc5346f8eb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d3017f-15f6-5665-8d32-7b21ba1ee941/87d3017f-15f6-5665-8d32-7b21ba1ee941_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_1d3e09cfbae7b70598663c126c86daf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d3017f-15f6-5665-8d32-7b21ba1ee941/87d3017f-15f6-5665-8d32-7b21ba1ee941_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/c5/91c51d0662e2e0afffdb7b42cc2c1a6c/pa/XX88636_9e070e49bbaa40402717e7ae2acc52d8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX88636%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [auto1.be] INFO: Saving data for XX88636: {'created_time': 1774643451.479542, 'last_price_update_time': 1774643451.479552, 'auction_closing_time': 1774713982.0}
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XX88636') HTTP/1.1" 204 0
2026-03-27 20:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308
2026-03-27 20:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308
2026-03-27 20:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308 to the API
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MK30308>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:41Z',
 'fuel_type': 'petrol',
 'id': '65a64476-33bd-5625-b0bf-97078fff89b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK30308',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 37304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_815ecccb159e482c02ccfd0e7470b23d.jpg',
                'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_2b5a26efcd0c88bb9cd5699d6634c2f8.jpg',
                'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_b81388c83a1bbc55ef7b4dea7fc85279.jpg',
                'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_afd66bb666734621aa8169d7dd762cb5.jpg',
                'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_2383395affd0487d9eeda51f73af3692.jpg',
                'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_215b9e5e8437b782d44cebed02f95095.jpg',
                'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_485e6b88f0c78a26602f4b7851dde3ef.jpg',
                'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_f97a18b82f1a9ccb4e589609313dd9e1.jpg',
                'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_0f6942eba68fa81540405d0c1719758d.jpg',
                'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_6bb47d3ca57d3559544540e8fcb33a25.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a64476-33bd-5625-b0bf-97078fff89b2/65a64476-33bd-5625-b0bf-97078fff89b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_815ecccb159e482c02ccfd0e7470b23d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a64476-33bd-5625-b0bf-97078fff89b2/65a64476-33bd-5625-b0bf-97078fff89b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_2b5a26efcd0c88bb9cd5699d6634c2f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a64476-33bd-5625-b0bf-97078fff89b2/65a64476-33bd-5625-b0bf-97078fff89b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_b81388c83a1bbc55ef7b4dea7fc85279.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a64476-33bd-5625-b0bf-97078fff89b2/65a64476-33bd-5625-b0bf-97078fff89b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_afd66bb666734621aa8169d7dd762cb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a64476-33bd-5625-b0bf-97078fff89b2/65a64476-33bd-5625-b0bf-97078fff89b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_2383395affd0487d9eeda51f73af3692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a64476-33bd-5625-b0bf-97078fff89b2/65a64476-33bd-5625-b0bf-97078fff89b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_215b9e5e8437b782d44cebed02f95095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a64476-33bd-5625-b0bf-97078fff89b2/65a64476-33bd-5625-b0bf-97078fff89b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_485e6b88f0c78a26602f4b7851dde3ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a64476-33bd-5625-b0bf-97078fff89b2/65a64476-33bd-5625-b0bf-97078fff89b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_f97a18b82f1a9ccb4e589609313dd9e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a64476-33bd-5625-b0bf-97078fff89b2/65a64476-33bd-5625-b0bf-97078fff89b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_0f6942eba68fa81540405d0c1719758d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a64476-33bd-5625-b0bf-97078fff89b2/65a64476-33bd-5625-b0bf-97078fff89b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/ba/4aba8bc17af73d9cc2cc6bd455d9f7da/pa/MK30308_6bb47d3ca57d3559544540e8fcb33a25.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [auto1.be] INFO: Saving data for MK30308: {'created_time': 1774643451.803545, 'last_price_update_time': 1774643451.803557, 'auction_closing_time': 1774715381.0}
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MK30308') HTTP/1.1" 204 0
2026-03-27 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB83669> (referer: https://www.auto1.com/v1/car-details-view/JB83669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:51 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1659 | hits on page: 40
2026-03-27 20:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d563c37a-1f7a-5654-85ab-55784842c949 with identifier: JB83669
2026-03-27 20:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d563c37a-1f7a-5654-85ab-55784842c949 with scrape type 1
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d563c37a-1f7a-5654-85ab-55784842c949
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F22%252F11227257a861846db580245ebc6a2e04%252Fpa%252FJB83669_09d399ec92847262ccdddf68b54300a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_09d399ec92847262ccdddf68b54300a8.jpg already downloaded
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F22%252F11227257a861846db580245ebc6a2e04%252Fpa%252FJB83669_9674c582848501bb303c683b2ad5874d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_9674c582848501bb303c683b2ad5874d.jpg already downloaded
2026-03-27 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F22%252F11227257a861846db580245ebc6a2e04%252Fpa%252FJB83669_ba0d3d6502b8f261d32f499460de36b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_ba0d3d6502b8f261d32f499460de36b6.jpg already downloaded
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F22%252F11227257a861846db580245ebc6a2e04%252Fpa%252FJB83669_d27acad23dd0b613e7e46e4846e57fd2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_d27acad23dd0b613e7e46e4846e57fd2.jpg already downloaded
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F22%252F11227257a861846db580245ebc6a2e04%252Fpa%252FJB83669_9078116b26322e400bcc897b608684e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_9078116b26322e400bcc897b608684e0.jpg already downloaded
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F22%252F11227257a861846db580245ebc6a2e04%252Fpa%252FJB83669_4e5f3fa1a4deb487b1d70aa97d530113.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_4e5f3fa1a4deb487b1d70aa97d530113.jpg already downloaded
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F22%252F11227257a861846db580245ebc6a2e04%252Fpa%252FJB83669_cd470e0703abe71e0355798fd332ad7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_cd470e0703abe71e0355798fd332ad7a.jpg already downloaded
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F22%252F11227257a861846db580245ebc6a2e04%252Fpa%252FJB83669_39877a6860c9ed99c9fd54fa7662be0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_39877a6860c9ed99c9fd54fa7662be0e.jpg already downloaded
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F22%252F11227257a861846db580245ebc6a2e04%252Fpa%252FJB83669_4be300deba44fcc13af8876046dc6698.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_4be300deba44fcc13af8876046dc6698.jpg already downloaded
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F22%252F11227257a861846db580245ebc6a2e04%252Fpa%252FJB83669_cc85c2ed98204881d1f26a75387ab6fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_cc85c2ed98204881d1f26a75387ab6fd.jpg already downloaded
2026-03-27 20:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d563c37a-1f7a-5654-85ab-55784842c949, identifier: JB83669
2026-03-27 20:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d563c37a-1f7a-5654-85ab-55784842c949 with identifier: JB83669
2026-03-27 20:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d563c37a-1f7a-5654-85ab-55784842c949 with identifier: JB83669
2026-03-27 20:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d563c37a-1f7a-5654-85ab-55784842c949 with identifier: JB83669 to the API
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JB83669>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:23:45Z',
 'fuel_type': 'petrol',
 'id': 'd563c37a-1f7a-5654-85ab-55784842c949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB83669',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 159045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_09d399ec92847262ccdddf68b54300a8.jpg',
                'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_9674c582848501bb303c683b2ad5874d.jpg',
                'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_ba0d3d6502b8f261d32f499460de36b6.jpg',
                'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_d27acad23dd0b613e7e46e4846e57fd2.jpg',
                'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_9078116b26322e400bcc897b608684e0.jpg',
                'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_4e5f3fa1a4deb487b1d70aa97d530113.jpg',
                'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_cd470e0703abe71e0355798fd332ad7a.jpg',
                'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_39877a6860c9ed99c9fd54fa7662be0e.jpg',
                'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_4be300deba44fcc13af8876046dc6698.jpg',
                'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_cc85c2ed98204881d1f26a75387ab6fd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d563c37a-1f7a-5654-85ab-55784842c949/d563c37a-1f7a-5654-85ab-55784842c949_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_09d399ec92847262ccdddf68b54300a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d563c37a-1f7a-5654-85ab-55784842c949/d563c37a-1f7a-5654-85ab-55784842c949_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_9674c582848501bb303c683b2ad5874d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d563c37a-1f7a-5654-85ab-55784842c949/d563c37a-1f7a-5654-85ab-55784842c949_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_ba0d3d6502b8f261d32f499460de36b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d563c37a-1f7a-5654-85ab-55784842c949/d563c37a-1f7a-5654-85ab-55784842c949_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_d27acad23dd0b613e7e46e4846e57fd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d563c37a-1f7a-5654-85ab-55784842c949/d563c37a-1f7a-5654-85ab-55784842c949_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_9078116b26322e400bcc897b608684e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d563c37a-1f7a-5654-85ab-55784842c949/d563c37a-1f7a-5654-85ab-55784842c949_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_4e5f3fa1a4deb487b1d70aa97d530113.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d563c37a-1f7a-5654-85ab-55784842c949/d563c37a-1f7a-5654-85ab-55784842c949_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_cd470e0703abe71e0355798fd332ad7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d563c37a-1f7a-5654-85ab-55784842c949/d563c37a-1f7a-5654-85ab-55784842c949_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_39877a6860c9ed99c9fd54fa7662be0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d563c37a-1f7a-5654-85ab-55784842c949/d563c37a-1f7a-5654-85ab-55784842c949_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_4be300deba44fcc13af8876046dc6698.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d563c37a-1f7a-5654-85ab-55784842c949/d563c37a-1f7a-5654-85ab-55784842c949_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/22/11227257a861846db580245ebc6a2e04/pa/JB83669_cc85c2ed98204881d1f26a75387ab6fd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2018}
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB83669%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [auto1.be] INFO: Saving data for JB83669: {'created_time': 1774643452.524242, 'last_price_update_time': 1774643452.524254, 'auction_closing_time': 1774715025.0}
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JB83669') HTTP/1.1" 204 0
2026-03-27 20:30:52 [auto1.be] INFO: Found listing with ID: YF40273
2026-03-27 20:30:52 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW00406%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [auto1.be] INFO: Scrape type for RW00406: 0
2026-03-27 20:30:52 [auto1.be] INFO: Found listing with ID: UA36115
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36115%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [auto1.be] INFO: Scrape type for UA36115: 0
2026-03-27 20:30:52 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-27 20:30:52 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [auto1.be] INFO: Scrape type for XH41981: 0
2026-03-27 20:30:52 [auto1.be] INFO: Found listing with ID: UT11356
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT11356%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [auto1.be] INFO: Scrape type for UT11356: 0
2026-03-27 20:30:52 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-27 20:30:52 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [auto1.be] INFO: Scrape type for LK16000: 0
2026-03-27 20:30:52 [auto1.be] INFO: Found listing with ID: KH30418
2026-03-27 20:30:52 [auto1.be] INFO: Found listing with ID: HB25779
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB25779%27 HTTP/1.1" 200 None
2026-03-27 20:30:52 [auto1.be] INFO: Scrape type for HB25779: 2
2026-03-27 20:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d3f7121-3e50-500c-93a1-a24709d03a1a with identifier: HB25779
2026-03-27 20:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3f7121-3e50-500c-93a1-a24709d03a1a with scrape type 2
2026-03-27 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d3f7121-3e50-500c-93a1-a24709d03a1a with scrape type 2
2026-03-27 20:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d3f7121-3e50-500c-93a1-a24709d03a1a, identifier: HB25779
2026-03-27 20:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d3f7121-3e50-500c-93a1-a24709d03a1a with identifier: HB25779
2026-03-27 20:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d3f7121-3e50-500c-93a1-a24709d03a1a with identifier: HB25779
2026-03-27 20:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d3f7121-3e50-500c-93a1-a24709d03a1a with identifier: HB25779 to the API
2026-03-27 20:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:36Z',
 'fuel_type': 'diesel',
 'id': '8d3f7121-3e50-500c-93a1-a24709d03a1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB25779',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 163708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-24',
 'seller_name': None,
 'title': 'BMW 3er 318d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2016}
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB25779%27 HTTP/1.1" 200 None
2026-03-27 20:30:53 [auto1.be] INFO: Saving data for HB25779: {'auction_closing_time': 1774716156.0, 'created_time': 1773301773.031478, 'last_price_update_time': 1774643453.100252}
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HB25779') HTTP/1.1" 204 0
2026-03-27 20:30:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:53 [auto1.be] INFO: Found listing with ID: CW76300
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW76300%27 HTTP/1.1" 200 None
2026-03-27 20:30:53 [auto1.be] INFO: Scrape type for CW76300: 0
2026-03-27 20:30:53 [auto1.be] INFO: Found listing with ID: KX63098
2026-03-27 20:30:53 [auto1.be] INFO: Found listing with ID: CK71488
2026-03-27 20:30:53 [auto1.be] INFO: Found listing with ID: BF87746
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF87746%27 HTTP/1.1" 200 None
2026-03-27 20:30:53 [auto1.be] INFO: Scrape type for BF87746: 2
2026-03-27 20:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6492975f-7b04-5e0b-ad16-c6c512a7b674 with identifier: BF87746
2026-03-27 20:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6492975f-7b04-5e0b-ad16-c6c512a7b674 with scrape type 2
2026-03-27 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6492975f-7b04-5e0b-ad16-c6c512a7b674 with scrape type 2
2026-03-27 20:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6492975f-7b04-5e0b-ad16-c6c512a7b674, identifier: BF87746
2026-03-27 20:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6492975f-7b04-5e0b-ad16-c6c512a7b674 with identifier: BF87746
2026-03-27 20:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6492975f-7b04-5e0b-ad16-c6c512a7b674 with identifier: BF87746
2026-03-27 20:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6492975f-7b04-5e0b-ad16-c6c512a7b674 with identifier: BF87746 to the API
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:23:31Z',
 'fuel_type': 'hybrid',
 'id': '6492975f-7b04-5e0b-ad16-c6c512a7b674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF87746',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 160143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 1.6 T-GDI Hybrid Style 4WD',
 'transmission': 'automatic',
 'trim': 'Style 4WD',
 'year': 2022}
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF87746%27 HTTP/1.1" 200 None
2026-03-27 20:30:53 [auto1.be] INFO: Saving data for BF87746: {'auction_closing_time': 1774715011.0, 'created_time': 1774438309.069493, 'last_price_update_time': 1774643453.601989}
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BF87746') HTTP/1.1" 204 0
2026-03-27 20:30:53 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-27 20:30:53 [auto1.be] INFO: Scrape type for RR89556: 0
2026-03-27 20:30:53 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-27 20:30:53 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-27 20:30:53 [auto1.be] INFO: Scrape type for JN34238: 2
2026-03-27 20:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238
2026-03-27 20:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a16dee46-3c6b-5250-b941-c1842c6f1538 with scrape type 2
2026-03-27 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a16dee46-3c6b-5250-b941-c1842c6f1538 with scrape type 2
2026-03-27 20:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a16dee46-3c6b-5250-b941-c1842c6f1538, identifier: JN34238
2026-03-27 20:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238
2026-03-27 20:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238
2026-03-27 20:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238 to the API
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:54:46Z',
 'fuel_type': 'diesel',
 'id': 'a16dee46-3c6b-5250-b941-c1842c6f1538',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN34238',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 252589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-09',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-27 20:30:53 [auto1.be] INFO: Saving data for JN34238: {'auction_closing_time': 1774716886.0, 'created_time': 1773237973.441181, 'last_price_update_time': 1774643453.996854}
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JN34238') HTTP/1.1" 204 0
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: NP31982
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP31982%27 HTTP/1.1" 200 None
2026-03-27 20:30:54 [auto1.be] INFO: Scrape type for NP31982: 2
2026-03-27 20:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 420fc736-ec95-5b6d-9e46-e3abc5437ab4 with identifier: NP31982
2026-03-27 20:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 420fc736-ec95-5b6d-9e46-e3abc5437ab4 with scrape type 2
2026-03-27 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 420fc736-ec95-5b6d-9e46-e3abc5437ab4 with scrape type 2
2026-03-27 20:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 420fc736-ec95-5b6d-9e46-e3abc5437ab4, identifier: NP31982
2026-03-27 20:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 420fc736-ec95-5b6d-9e46-e3abc5437ab4 with identifier: NP31982
2026-03-27 20:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 420fc736-ec95-5b6d-9e46-e3abc5437ab4 with identifier: NP31982
2026-03-27 20:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 420fc736-ec95-5b6d-9e46-e3abc5437ab4 with identifier: NP31982 to the API
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:27:54Z',
 'fuel_type': 'petrol',
 'id': '420fc736-ec95-5b6d-9e46-e3abc5437ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP31982',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 90431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-21',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2021}
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP31982%27 HTTP/1.1" 200 None
2026-03-27 20:30:54 [auto1.be] INFO: Saving data for NP31982: {'auction_closing_time': 1774715274.0, 'created_time': 1774438283.834096, 'last_price_update_time': 1774643454.382618}
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP31982') HTTP/1.1" 204 0
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY23736%27 HTTP/1.1" 200 None
2026-03-27 20:30:54 [auto1.be] INFO: Scrape type for ZY23736: 0
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: MR44504
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: BU20603
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: DJ10477
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ10477%27 HTTP/1.1" 200 None
2026-03-27 20:30:54 [auto1.be] INFO: Scrape type for DJ10477: 2
2026-03-27 20:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b93d9bb3-a92c-54fd-bc9b-667d0230e83a with identifier: DJ10477
2026-03-27 20:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b93d9bb3-a92c-54fd-bc9b-667d0230e83a with scrape type 2
2026-03-27 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b93d9bb3-a92c-54fd-bc9b-667d0230e83a with scrape type 2
2026-03-27 20:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b93d9bb3-a92c-54fd-bc9b-667d0230e83a, identifier: DJ10477
2026-03-27 20:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b93d9bb3-a92c-54fd-bc9b-667d0230e83a with identifier: DJ10477
2026-03-27 20:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b93d9bb3-a92c-54fd-bc9b-667d0230e83a with identifier: DJ10477
2026-03-27 20:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b93d9bb3-a92c-54fd-bc9b-667d0230e83a with identifier: DJ10477 to the API
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:28:09Z',
 'fuel_type': 'petrol',
 'id': 'b93d9bb3-a92c-54fd-bc9b-667d0230e83a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ10477',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20 Active',
 'odometer': 56311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-03',
 'seller_name': None,
 'title': 'Hyundai i20 Active 1.0 TGDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ10477%27 HTTP/1.1" 200 None
2026-03-27 20:30:54 [auto1.be] INFO: Saving data for DJ10477: {'auction_closing_time': 1774715289.0, 'created_time': 1774438315.631478, 'last_price_update_time': 1774643454.787672}
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ10477') HTTP/1.1" 204 0
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-27 20:30:54 [auto1.be] INFO: Scrape type for YD21406: 0
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: VF99667
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-27 20:30:54 [auto1.be] INFO: Scrape type for WK92284: 0
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: CC33949
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC33949%27 HTTP/1.1" 200 None
2026-03-27 20:30:54 [auto1.be] INFO: Scrape type for CC33949: 0
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: ZZ76068
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ76068%27 HTTP/1.1" 200 None
2026-03-27 20:30:54 [auto1.be] INFO: Scrape type for ZZ76068: 0
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-27 20:30:54 [auto1.be] INFO: Scrape type for DM43787: 0
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: TY40613
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY40613%27 HTTP/1.1" 200 None
2026-03-27 20:30:54 [auto1.be] INFO: Scrape type for TY40613: 0
2026-03-27 20:30:54 [auto1.be] INFO: Found listing with ID: FC96000
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC96000%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [auto1.be] INFO: Scrape type for FC96000: 0
2026-03-27 20:30:55 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [auto1.be] INFO: Scrape type for DH81993: 2
2026-03-27 20:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993
2026-03-27 20:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37c842aa-bc4f-5da9-a78d-74a263351f67 with scrape type 2
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37c842aa-bc4f-5da9-a78d-74a263351f67 with scrape type 2
2026-03-27 20:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 37c842aa-bc4f-5da9-a78d-74a263351f67, identifier: DH81993
2026-03-27 20:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993
2026-03-27 20:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993
2026-03-27 20:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993 to the API
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:43:42Z',
 'fuel_type': 'diesel',
 'id': '37c842aa-bc4f-5da9-a78d-74a263351f67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH81993',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 164928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-10',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI quattro Ambition',
 'transmission': 'manual',
 'trim': 'quattro Ambition',
 'year': 2014}
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [auto1.be] INFO: Saving data for DH81993: {'auction_closing_time': 1774716222.0, 'created_time': 1774557032.149476, 'last_price_update_time': 1774643455.368705}
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH81993') HTTP/1.1" 204 0
2026-03-27 20:30:55 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [auto1.be] INFO: Scrape type for DW61635: 0
2026-03-27 20:30:55 [auto1.be] INFO: Found listing with ID: XF90058
2026-03-27 20:30:55 [auto1.be] INFO: Found listing with ID: RL73626
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL73626%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [auto1.be] INFO: Scrape type for RL73626: 0
2026-03-27 20:30:55 [auto1.be] INFO: Found listing with ID: WG55963
2026-03-27 20:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL42374> (referer: https://www.auto1.com/v1/car-details-view/KL42374/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374
2026-03-27 20:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with scrape type 1
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F93%252Fd89311452b9f083fe91f7802d88725e4%252Fpa%252FKL42374_ff58a0c96c96bdda98d7385542e720bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_ff58a0c96c96bdda98d7385542e720bc.jpg already downloaded
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F93%252Fd89311452b9f083fe91f7802d88725e4%252Fpa%252FKL42374_7cdfd5c3e597b3477f53a767da982524.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_7cdfd5c3e597b3477f53a767da982524.jpg already downloaded
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F93%252Fd89311452b9f083fe91f7802d88725e4%252Fpa%252FKL42374_4f1de1c705149734d1e1640025345ab2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_4f1de1c705149734d1e1640025345ab2.jpg already downloaded
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F93%252Fd89311452b9f083fe91f7802d88725e4%252Fpa%252FKL42374_5415d5877c49136914d96e67039bd0c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_5415d5877c49136914d96e67039bd0c2.jpg already downloaded
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F93%252Fd89311452b9f083fe91f7802d88725e4%252Fpa%252FKL42374_03e9000d7c234740e40ca7e8483e21fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_03e9000d7c234740e40ca7e8483e21fd.jpg already downloaded
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F93%252Fd89311452b9f083fe91f7802d88725e4%252Fpa%252FKL42374_915020a9119e0a1410f66d9759a6680a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_915020a9119e0a1410f66d9759a6680a.jpg already downloaded
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F93%252Fd89311452b9f083fe91f7802d88725e4%252Fpa%252FKL42374_e133646d9c22d28ff54369251e3b24ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_e133646d9c22d28ff54369251e3b24ae.jpg already downloaded
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F93%252Fd89311452b9f083fe91f7802d88725e4%252Fpa%252FKL42374_c97bd95049ce9f391c34f0bc2baa1503.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_c97bd95049ce9f391c34f0bc2baa1503.jpg already downloaded
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F93%252Fd89311452b9f083fe91f7802d88725e4%252Fpa%252FKL42374_9352609f6dd4180e6176d80fa3ae3567.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_9352609f6dd4180e6176d80fa3ae3567.jpg already downloaded
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F93%252Fd89311452b9f083fe91f7802d88725e4%252Fpa%252FKL42374_fa33da01a51d2d012f5c4996cd09bce5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_fa33da01a51d2d012f5c4996cd09bce5.jpg already downloaded
2026-03-27 20:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50, identifier: KL42374
2026-03-27 20:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374
2026-03-27 20:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374
2026-03-27 20:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374 to the API
2026-03-27 20:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KL42374>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 275,
 'expiration_date': '2026-03-28T16:19:32Z',
 'fuel_type': 'diesel',
 'id': 'ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL42374',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Maserati',
 'model': 'Ghibli',
 'odometer': 126833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_ff58a0c96c96bdda98d7385542e720bc.jpg',
                'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_7cdfd5c3e597b3477f53a767da982524.jpg',
                'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_4f1de1c705149734d1e1640025345ab2.jpg',
                'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_5415d5877c49136914d96e67039bd0c2.jpg',
                'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_03e9000d7c234740e40ca7e8483e21fd.jpg',
                'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_915020a9119e0a1410f66d9759a6680a.jpg',
                'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_e133646d9c22d28ff54369251e3b24ae.jpg',
                'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_c97bd95049ce9f391c34f0bc2baa1503.jpg',
                'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_9352609f6dd4180e6176d80fa3ae3567.jpg',
                'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_fa33da01a51d2d012f5c4996cd09bce5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50/ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_ff58a0c96c96bdda98d7385542e720bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50/ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_7cdfd5c3e597b3477f53a767da982524.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50/ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_4f1de1c705149734d1e1640025345ab2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50/ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_5415d5877c49136914d96e67039bd0c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50/ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_03e9000d7c234740e40ca7e8483e21fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50/ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_915020a9119e0a1410f66d9759a6680a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50/ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_e133646d9c22d28ff54369251e3b24ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50/ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_c97bd95049ce9f391c34f0bc2baa1503.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50/ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_9352609f6dd4180e6176d80fa3ae3567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50/ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/93/d89311452b9f083fe91f7802d88725e4/pa/KL42374_fa33da01a51d2d012f5c4996cd09bce5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Ghibli 3.0 V6 Diesel Gran Sport',
 'transmission': 'automatic',
 'trim': 'Gran Sport',
 'year': 2018}
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-27 20:30:56 [auto1.be] INFO: Saving data for KL42374: {'created_time': 1774643456.198216, 'last_price_update_time': 1774643456.198226, 'auction_closing_time': 1774714772.0}
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KL42374') HTTP/1.1" 204 0
2026-03-27 20:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM92505> (referer: https://www.auto1.com/v1/car-details-view/YM92505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:30:56 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1659 | hits on page: 40
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: RY67713
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY67713%27 HTTP/1.1" 200 None
2026-03-27 20:30:56 [auto1.be] INFO: Scrape type for RY67713: 0
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: LK47918
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-27 20:30:56 [auto1.be] INFO: Scrape type for ML85388: 0
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: GT24920
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: CK78813
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: FL07479
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: KV70453
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-27 20:30:56 [auto1.be] INFO: Scrape type for WU67286: 0
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: XB51767
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB51767%27 HTTP/1.1" 200 None
2026-03-27 20:30:56 [auto1.be] INFO: Scrape type for XB51767: 0
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-27 20:30:56 [auto1.be] INFO: Found listing with ID: CT01503
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT01503%27 HTTP/1.1" 200 None
2026-03-27 20:30:56 [auto1.be] INFO: Scrape type for CT01503: 2
2026-03-27 20:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab74430f-47ab-56fe-9c02-57c4f8d31013 with identifier: CT01503
2026-03-27 20:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab74430f-47ab-56fe-9c02-57c4f8d31013 with scrape type 2
2026-03-27 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab74430f-47ab-56fe-9c02-57c4f8d31013 with scrape type 2
2026-03-27 20:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ab74430f-47ab-56fe-9c02-57c4f8d31013, identifier: CT01503
2026-03-27 20:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ab74430f-47ab-56fe-9c02-57c4f8d31013 with identifier: CT01503
2026-03-27 20:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ab74430f-47ab-56fe-9c02-57c4f8d31013 with identifier: CT01503
2026-03-27 20:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ab74430f-47ab-56fe-9c02-57c4f8d31013 with identifier: CT01503 to the API
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:07Z',
 'fuel_type': 'diesel',
 'id': 'ab74430f-47ab-56fe-9c02-57c4f8d31013',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT01503',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 253450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-04',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Instyle ClearTec 4WD',
 'transmission': 'manual',
 'trim': 'Instyle ClearTec 4WD',
 'year': 2013}
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT01503%27 HTTP/1.1" 200 None
2026-03-27 20:30:56 [auto1.be] INFO: Saving data for CT01503: {'auction_closing_time': 1774716427.0, 'created_time': 1774438281.619692, 'last_price_update_time': 1774643456.886392}
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CT01503') HTTP/1.1" 204 0
2026-03-27 20:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f62597af-246c-5906-a12e-f631ebe06f86 with identifier: YM92505
2026-03-27 20:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f62597af-246c-5906-a12e-f631ebe06f86 with scrape type 1
2026-03-27 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f62597af-246c-5906-a12e-f631ebe06f86
2026-03-27 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1b%252Fae1b53fa7ccbbe1b9e1581aa304214bf%252Fpa%252FYM92505_0f9d12cf2f0a445bc5c5f6e75ea740a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_0f9d12cf2f0a445bc5c5f6e75ea740a0.jpg already downloaded
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1b%252Fae1b53fa7ccbbe1b9e1581aa304214bf%252Fpa%252FYM92505_f784d89edbbd1f3033170ff89fdc28f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_f784d89edbbd1f3033170ff89fdc28f1.jpg already downloaded
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1b%252Fae1b53fa7ccbbe1b9e1581aa304214bf%252Fpa%252FYM92505_5951fdff37290602cf72e201f1f6a64b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_5951fdff37290602cf72e201f1f6a64b.jpg already downloaded
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1b%252Fae1b53fa7ccbbe1b9e1581aa304214bf%252Fpa%252FYM92505_d46b47d7b1f48466d0e7d385dabc4158.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_d46b47d7b1f48466d0e7d385dabc4158.jpg already downloaded
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1b%252Fae1b53fa7ccbbe1b9e1581aa304214bf%252Fpa%252FYM92505_ac320555623ad360e8fd7bf7338764ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_ac320555623ad360e8fd7bf7338764ba.jpg already downloaded
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1b%252Fae1b53fa7ccbbe1b9e1581aa304214bf%252Fpa%252FYM92505_72feaa4063d14f8816b9b0dbeb2ccc04.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_72feaa4063d14f8816b9b0dbeb2ccc04.jpg already downloaded
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1b%252Fae1b53fa7ccbbe1b9e1581aa304214bf%252Fpa%252FYM92505_c6721c79c398136d72bdbcfa6fd5e5c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_c6721c79c398136d72bdbcfa6fd5e5c5.jpg already downloaded
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1b%252Fae1b53fa7ccbbe1b9e1581aa304214bf%252Fpa%252FYM92505_85a8f424cca535cec3ba00a94476e78b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_85a8f424cca535cec3ba00a94476e78b.jpg already downloaded
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1b%252Fae1b53fa7ccbbe1b9e1581aa304214bf%252Fpa%252FYM92505_f2a67076448fd0e8f0b32130122f9857.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_f2a67076448fd0e8f0b32130122f9857.jpg already downloaded
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1b%252Fae1b53fa7ccbbe1b9e1581aa304214bf%252Fpa%252FYM92505_8f172d55c3594e44c052db17d7c03ebb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_8f172d55c3594e44c052db17d7c03ebb.jpg already downloaded
2026-03-27 20:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f62597af-246c-5906-a12e-f631ebe06f86, identifier: YM92505
2026-03-27 20:30:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:30:57 [auto1.be] INFO: Found listing with ID: BT18330
2026-03-27 20:30:57 [auto1.be] INFO: Found listing with ID: GU08126
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08126%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [auto1.be] INFO: Scrape type for GU08126: 0
2026-03-27 20:30:57 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [auto1.be] INFO: Scrape type for VA07887: 0
2026-03-27 20:30:57 [auto1.be] INFO: Found listing with ID: JF01400
2026-03-27 20:30:57 [auto1.be] INFO: Found listing with ID: XR56379
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR56379%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [auto1.be] INFO: Scrape type for XR56379: 0
2026-03-27 20:30:57 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [auto1.be] INFO: Scrape type for MB19665: 0
2026-03-27 20:30:57 [auto1.be] INFO: Found listing with ID: VL13165
2026-03-27 20:30:57 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-27 20:30:57 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [auto1.be] INFO: Scrape type for TW09601: 2
2026-03-27 20:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601
2026-03-27 20:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 692d14de-a005-5420-90ce-56cf238963bc with scrape type 2
2026-03-27 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 692d14de-a005-5420-90ce-56cf238963bc with scrape type 2
2026-03-27 20:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 692d14de-a005-5420-90ce-56cf238963bc, identifier: TW09601
2026-03-27 20:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f62597af-246c-5906-a12e-f631ebe06f86 with identifier: YM92505
2026-03-27 20:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f62597af-246c-5906-a12e-f631ebe06f86 with identifier: YM92505
2026-03-27 20:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f62597af-246c-5906-a12e-f631ebe06f86 with identifier: YM92505 to the API
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YM92505>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:02:56Z',
 'fuel_type': 'petrol',
 'id': 'f62597af-246c-5906-a12e-f631ebe06f86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM92505',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 105252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_0f9d12cf2f0a445bc5c5f6e75ea740a0.jpg',
                'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_f784d89edbbd1f3033170ff89fdc28f1.jpg',
                'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_5951fdff37290602cf72e201f1f6a64b.jpg',
                'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_d46b47d7b1f48466d0e7d385dabc4158.jpg',
                'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_ac320555623ad360e8fd7bf7338764ba.jpg',
                'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_72feaa4063d14f8816b9b0dbeb2ccc04.jpg',
                'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_c6721c79c398136d72bdbcfa6fd5e5c5.jpg',
                'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_85a8f424cca535cec3ba00a94476e78b.jpg',
                'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_f2a67076448fd0e8f0b32130122f9857.jpg',
                'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_8f172d55c3594e44c052db17d7c03ebb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62597af-246c-5906-a12e-f631ebe06f86/f62597af-246c-5906-a12e-f631ebe06f86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_0f9d12cf2f0a445bc5c5f6e75ea740a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62597af-246c-5906-a12e-f631ebe06f86/f62597af-246c-5906-a12e-f631ebe06f86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_f784d89edbbd1f3033170ff89fdc28f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62597af-246c-5906-a12e-f631ebe06f86/f62597af-246c-5906-a12e-f631ebe06f86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_5951fdff37290602cf72e201f1f6a64b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62597af-246c-5906-a12e-f631ebe06f86/f62597af-246c-5906-a12e-f631ebe06f86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_d46b47d7b1f48466d0e7d385dabc4158.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62597af-246c-5906-a12e-f631ebe06f86/f62597af-246c-5906-a12e-f631ebe06f86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_ac320555623ad360e8fd7bf7338764ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62597af-246c-5906-a12e-f631ebe06f86/f62597af-246c-5906-a12e-f631ebe06f86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_72feaa4063d14f8816b9b0dbeb2ccc04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62597af-246c-5906-a12e-f631ebe06f86/f62597af-246c-5906-a12e-f631ebe06f86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_c6721c79c398136d72bdbcfa6fd5e5c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62597af-246c-5906-a12e-f631ebe06f86/f62597af-246c-5906-a12e-f631ebe06f86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_85a8f424cca535cec3ba00a94476e78b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62597af-246c-5906-a12e-f631ebe06f86/f62597af-246c-5906-a12e-f631ebe06f86_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_f2a67076448fd0e8f0b32130122f9857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62597af-246c-5906-a12e-f631ebe06f86/f62597af-246c-5906-a12e-f631ebe06f86_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1b/ae1b53fa7ccbbe1b9e1581aa304214bf/pa/YM92505_8f172d55c3594e44c052db17d7c03ebb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2019}
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM92505%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [auto1.be] INFO: Saving data for YM92505: {'created_time': 1774643457.690254, 'last_price_update_time': 1774643457.690264, 'auction_closing_time': 1774713776.0}
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YM92505') HTTP/1.1" 204 0
2026-03-27 20:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601
2026-03-27 20:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601
2026-03-27 20:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601 to the API
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:08:00Z',
 'fuel_type': 'diesel',
 'id': '692d14de-a005-5420-90ce-56cf238963bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW09601',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 182252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-09',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-27 20:30:57 [auto1.be] INFO: Saving data for TW09601: {'auction_closing_time': 1774714080.0, 'created_time': 1774557030.384689, 'last_price_update_time': 1774643457.975432}
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW09601') HTTP/1.1" 204 0
2026-03-27 20:30:58 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-27 20:30:58 [auto1.be] INFO: Scrape type for CN47453: 0
2026-03-27 20:30:58 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-27 20:30:58 [auto1.be] INFO: Found listing with ID: KV74957
2026-03-27 20:30:58 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-27 20:30:58 [auto1.be] INFO: Found listing with ID: UZ05678
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ05678%27 HTTP/1.1" 200 None
2026-03-27 20:30:58 [auto1.be] INFO: Scrape type for UZ05678: 2
2026-03-27 20:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d74a35a-ed14-5db6-9ce0-927a94160be8 with identifier: UZ05678
2026-03-27 20:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d74a35a-ed14-5db6-9ce0-927a94160be8 with scrape type 2
2026-03-27 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d74a35a-ed14-5db6-9ce0-927a94160be8 with scrape type 2
2026-03-27 20:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0d74a35a-ed14-5db6-9ce0-927a94160be8, identifier: UZ05678
2026-03-27 20:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0d74a35a-ed14-5db6-9ce0-927a94160be8 with identifier: UZ05678
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-27 20:30:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0d74a35a-ed14-5db6-9ce0-927a94160be8 with identifier: UZ05678
2026-03-27 20:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0d74a35a-ed14-5db6-9ce0-927a94160be8 with identifier: UZ05678 to the API
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:22:09Z',
 'fuel_type': 'petrol',
 'id': '0d74a35a-ed14-5db6-9ce0-927a94160be8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ05678',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 102051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-15',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2017}
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ05678%27 HTTP/1.1" 200 None
2026-03-27 20:30:58 [auto1.be] INFO: Saving data for UZ05678: {'auction_closing_time': 1774714929.0, 'created_time': 1773301674.751475, 'last_price_update_time': 1774643458.563588}
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UZ05678') HTTP/1.1" 204 0
2026-03-27 20:30:58 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56663%27 HTTP/1.1" 200 None
2026-03-27 20:30:58 [auto1.be] INFO: Scrape type for CW56663: 2
2026-03-27 20:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee8117f5-fff4-5f57-beac-f725f5d3f34e with identifier: CW56663
2026-03-27 20:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee8117f5-fff4-5f57-beac-f725f5d3f34e with scrape type 2
2026-03-27 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee8117f5-fff4-5f57-beac-f725f5d3f34e with scrape type 2
2026-03-27 20:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee8117f5-fff4-5f57-beac-f725f5d3f34e, identifier: CW56663
2026-03-27 20:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee8117f5-fff4-5f57-beac-f725f5d3f34e with identifier: CW56663
2026-03-27 20:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee8117f5-fff4-5f57-beac-f725f5d3f34e with identifier: CW56663
2026-03-27 20:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee8117f5-fff4-5f57-beac-f725f5d3f34e with identifier: CW56663 to the API
2026-03-27 20:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:47:16Z',
 'fuel_type': 'diesel',
 'id': 'ee8117f5-fff4-5f57-beac-f725f5d3f34e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW56663',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 335850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-07',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56663%27 HTTP/1.1" 200 None
2026-03-27 20:30:59 [auto1.be] INFO: Saving data for CW56663: {'auction_closing_time': 1774716436.0, 'created_time': 1773132812.940812, 'last_price_update_time': 1774643459.207036}
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CW56663') HTTP/1.1" 204 0
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: YJ37534
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: WX02409
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX02409%27 HTTP/1.1" 200 None
2026-03-27 20:30:59 [auto1.be] INFO: Scrape type for WX02409: 0
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: TA63870
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA63870%27 HTTP/1.1" 200 None
2026-03-27 20:30:59 [auto1.be] INFO: Scrape type for TA63870: 2
2026-03-27 20:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe387ca-49a3-5fa8-aa78-e702688b1326 with identifier: TA63870
2026-03-27 20:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe387ca-49a3-5fa8-aa78-e702688b1326 with scrape type 2
2026-03-27 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe387ca-49a3-5fa8-aa78-e702688b1326 with scrape type 2
2026-03-27 20:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cfe387ca-49a3-5fa8-aa78-e702688b1326, identifier: TA63870
2026-03-27 20:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cfe387ca-49a3-5fa8-aa78-e702688b1326 with identifier: TA63870
2026-03-27 20:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cfe387ca-49a3-5fa8-aa78-e702688b1326 with identifier: TA63870
2026-03-27 20:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cfe387ca-49a3-5fa8-aa78-e702688b1326 with identifier: TA63870 to the API
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:36:17Z',
 'fuel_type': 'diesel',
 'id': 'cfe387ca-49a3-5fa8-aa78-e702688b1326',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA63870',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 203675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-04',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2014}
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA63870%27 HTTP/1.1" 200 None
2026-03-27 20:30:59 [auto1.be] INFO: Saving data for TA63870: {'auction_closing_time': 1774715777.0, 'created_time': 1773132014.381868, 'last_price_update_time': 1774643459.596932}
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TA63870') HTTP/1.1" 204 0
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: CG04214
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: AV10256
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV10256%27 HTTP/1.1" 200 None
2026-03-27 20:30:59 [auto1.be] INFO: Scrape type for AV10256: 0
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: MV08230
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV08230%27 HTTP/1.1" 200 None
2026-03-27 20:30:59 [auto1.be] INFO: Scrape type for MV08230: 0
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: UD60313
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: BH51844
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: DZ18869
2026-03-27 20:30:59 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-27 20:30:59 [auto1.be] INFO: Scrape type for VM79296: 0
2026-03-27 20:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:00 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: PC57264
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for GN45273: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: GN83226
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: RD12029
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05656%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for GS05656: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: BW40259
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW40259%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for BW40259: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: GG52941
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG52941%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for GG52941: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: RZ07927
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: LR81556
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: PH43501
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH43501%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for PH43501: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: YJ60712
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60712%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for YJ60712: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: VP39360
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP39360%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for VP39360: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: LB60883
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB60883%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for LB60883: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for JX04101: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: CP28232
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP28232%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for CP28232: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: UJ84188
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: DK34546
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK34546%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for DK34546: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: UZ89311
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ89311%27 HTTP/1.1" 200 None
2026-03-27 20:31:00 [auto1.be] INFO: Scrape type for UZ89311: 0
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-27 20:31:00 [auto1.be] INFO: Found listing with ID: PW65130
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW65130%27 HTTP/1.1" 200 None
2026-03-27 20:31:01 [auto1.be] INFO: Scrape type for PW65130: 0
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: TW50978
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: ZM60414
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM60414%27 HTTP/1.1" 200 None
2026-03-27 20:31:01 [auto1.be] INFO: Scrape type for ZM60414: 0
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: GE86423
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: BJ47720
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ47720%27 HTTP/1.1" 200 None
2026-03-27 20:31:01 [auto1.be] INFO: Scrape type for BJ47720: 2
2026-03-27 20:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58ec457f-ce72-5f04-ba7c-40a979629d1b with identifier: BJ47720
2026-03-27 20:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58ec457f-ce72-5f04-ba7c-40a979629d1b with scrape type 2
2026-03-27 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58ec457f-ce72-5f04-ba7c-40a979629d1b with scrape type 2
2026-03-27 20:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58ec457f-ce72-5f04-ba7c-40a979629d1b, identifier: BJ47720
2026-03-27 20:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58ec457f-ce72-5f04-ba7c-40a979629d1b with identifier: BJ47720
2026-03-27 20:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58ec457f-ce72-5f04-ba7c-40a979629d1b with identifier: BJ47720
2026-03-27 20:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58ec457f-ce72-5f04-ba7c-40a979629d1b with identifier: BJ47720 to the API
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-28T16:45:15Z',
 'fuel_type': 'petrol',
 'id': '58ec457f-ce72-5f04-ba7c-40a979629d1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ47720',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 15229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-16',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.5 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2024}
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ47720%27 HTTP/1.1" 200 None
2026-03-27 20:31:01 [auto1.be] INFO: Saving data for BJ47720: {'auction_closing_time': 1774716315.0, 'created_time': 1773131820.519577, 'last_price_update_time': 1774643461.450614}
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ47720') HTTP/1.1" 204 0
2026-03-27 20:31:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-27 20:31:01 [auto1.be] INFO: Scrape type for LM00165: 0
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: AE10158
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: PW03008
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: DJ92015
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: ML32022
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: RM94904
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: YC12895
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: DF46667
2026-03-27 20:31:01 [auto1.be] INFO: Found listing with ID: TD21641
2026-03-27 20:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:02 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: YC93311
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC93311%27 HTTP/1.1" 200 None
2026-03-27 20:31:02 [auto1.be] INFO: Scrape type for YC93311: 0
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: GW94232
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: BX24259
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX24259%27 HTTP/1.1" 200 None
2026-03-27 20:31:02 [auto1.be] INFO: Scrape type for BX24259: 0
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: LB55394
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: MN64395
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN64395%27 HTTP/1.1" 200 None
2026-03-27 20:31:02 [auto1.be] INFO: Scrape type for MN64395: 0
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-27 20:31:02 [auto1.be] INFO: Scrape type for CM40127: 0
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: GB85934
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-27 20:31:02 [auto1.be] INFO: Scrape type for YH98972: 0
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: YX66002
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX66002%27 HTTP/1.1" 200 None
2026-03-27 20:31:02 [auto1.be] INFO: Scrape type for YX66002: 0
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: PR37992
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-27 20:31:02 [auto1.be] INFO: Scrape type for MC94265: 0
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: HL89741
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-27 20:31:02 [auto1.be] INFO: Scrape type for BA13225: 0
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: ER13199
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: FM74317
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: FT07874
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT07874%27 HTTP/1.1" 200 None
2026-03-27 20:31:02 [auto1.be] INFO: Scrape type for FT07874: 0
2026-03-27 20:31:02 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-27 20:31:02 [auto1.be] INFO: Scrape type for UN77217: 2
2026-03-27 20:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217
2026-03-27 20:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5b5348-5b73-5def-863b-43c052e63e32 with scrape type 2
2026-03-27 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e5b5348-5b73-5def-863b-43c052e63e32 with scrape type 2
2026-03-27 20:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e5b5348-5b73-5def-863b-43c052e63e32, identifier: UN77217
2026-03-27 20:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217
2026-03-27 20:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217
2026-03-27 20:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217 to the API
2026-03-27 20:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:03:23Z',
 'fuel_type': 'petrol',
 'id': '0e5b5348-5b73-5def-863b-43c052e63e32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN77217',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 70995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2013}
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-27 20:31:03 [auto1.be] INFO: Saving data for UN77217: {'auction_closing_time': 1774713803.0, 'created_time': 1774557033.83047, 'last_price_update_time': 1774643463.114782}
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UN77217') HTTP/1.1" 204 0
2026-03-27 20:31:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: PZ75244
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ75244%27 HTTP/1.1" 200 None
2026-03-27 20:31:03 [auto1.be] INFO: Scrape type for PZ75244: 0
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-27 20:31:03 [auto1.be] INFO: Scrape type for AJ68637: 0
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: UL09185
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL09185%27 HTTP/1.1" 200 None
2026-03-27 20:31:03 [auto1.be] INFO: Scrape type for UL09185: 0
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: WR10172
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: CE16850
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE16850%27 HTTP/1.1" 200 None
2026-03-27 20:31:03 [auto1.be] INFO: Scrape type for CE16850: 0
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: YN70818
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: DZ60295
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: YL95058
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: GV15800
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV15800%27 HTTP/1.1" 200 None
2026-03-27 20:31:03 [auto1.be] INFO: Scrape type for GV15800: 0
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: BY14138
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: EF17884
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-27 20:31:03 [auto1.be] INFO: Scrape type for FY43318: 0
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC09650%27 HTTP/1.1" 200 None
2026-03-27 20:31:03 [auto1.be] INFO: Scrape type for BC09650: 0
2026-03-27 20:31:03 [auto1.be] INFO: Found listing with ID: CN66713
2026-03-27 20:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:04 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: PR44884
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR44884%27 HTTP/1.1" 200 None
2026-03-27 20:31:04 [auto1.be] INFO: Scrape type for PR44884: 0
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: CV18687
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: MG36975
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG36975%27 HTTP/1.1" 200 None
2026-03-27 20:31:04 [auto1.be] INFO: Scrape type for MG36975: 0
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-27 20:31:04 [auto1.be] INFO: Scrape type for PY81659: 2
2026-03-27 20:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659
2026-03-27 20:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9597f0e3-fcf9-509d-88fa-2507f6954810 with scrape type 2
2026-03-27 20:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9597f0e3-fcf9-509d-88fa-2507f6954810 with scrape type 2
2026-03-27 20:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9597f0e3-fcf9-509d-88fa-2507f6954810, identifier: PY81659
2026-03-27 20:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659
2026-03-27 20:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659
2026-03-27 20:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659 to the API
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:16:43Z',
 'fuel_type': 'diesel',
 'id': '9597f0e3-fcf9-509d-88fa-2507f6954810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY81659',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 206050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-24',
 'seller_name': None,
 'title': 'BMW 3er 320d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-27 20:31:04 [auto1.be] INFO: Saving data for PY81659: {'auction_closing_time': 1774714603.0, 'created_time': 1774557060.829321, 'last_price_update_time': 1774643464.84679}
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY81659') HTTP/1.1" 204 0
2026-03-27 20:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-27 20:31:04 [auto1.be] INFO: Scrape type for PE83293: 0
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: CB57627
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB57627%27 HTTP/1.1" 200 None
2026-03-27 20:31:04 [auto1.be] INFO: Scrape type for CB57627: 0
2026-03-27 20:31:04 [auto1.be] INFO: Found listing with ID: ZW84802
2026-03-27 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW84802%27 HTTP/1.1" 200 None
2026-03-27 20:31:05 [auto1.be] INFO: Scrape type for ZW84802: 0
2026-03-27 20:31:05 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-27 20:31:05 [auto1.be] INFO: Found listing with ID: TM05069
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM05069%27 HTTP/1.1" 200 None
2026-03-27 20:31:05 [auto1.be] INFO: Scrape type for TM05069: 0
2026-03-27 20:31:05 [auto1.be] INFO: Found listing with ID: HZ77507
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ77507%27 HTTP/1.1" 200 None
2026-03-27 20:31:05 [auto1.be] INFO: Scrape type for HZ77507: 0
2026-03-27 20:31:05 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-27 20:31:05 [auto1.be] INFO: Found listing with ID: EJ24025
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ24025%27 HTTP/1.1" 200 None
2026-03-27 20:31:05 [auto1.be] INFO: Scrape type for EJ24025: 0
2026-03-27 20:31:05 [auto1.be] INFO: Found listing with ID: BY81514
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY81514%27 HTTP/1.1" 200 None
2026-03-27 20:31:05 [auto1.be] INFO: Scrape type for BY81514: 0
2026-03-27 20:31:05 [auto1.be] INFO: Found listing with ID: PG30723
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG30723%27 HTTP/1.1" 200 None
2026-03-27 20:31:05 [auto1.be] INFO: Scrape type for PG30723: 0
2026-03-27 20:31:05 [auto1.be] INFO: Found listing with ID: PL22892
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL22892%27 HTTP/1.1" 200 None
2026-03-27 20:31:05 [auto1.be] INFO: Scrape type for PL22892: 2
2026-03-27 20:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 125bcd50-f9f6-50b1-beee-be6555e60070 with identifier: PL22892
2026-03-27 20:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 125bcd50-f9f6-50b1-beee-be6555e60070 with scrape type 2
2026-03-27 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 125bcd50-f9f6-50b1-beee-be6555e60070 with scrape type 2
2026-03-27 20:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 125bcd50-f9f6-50b1-beee-be6555e60070, identifier: PL22892
2026-03-27 20:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 125bcd50-f9f6-50b1-beee-be6555e60070 with identifier: PL22892
2026-03-27 20:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 125bcd50-f9f6-50b1-beee-be6555e60070 with identifier: PL22892
2026-03-27 20:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 125bcd50-f9f6-50b1-beee-be6555e60070 with identifier: PL22892 to the API
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:16:59Z',
 'fuel_type': 'petrol',
 'id': '125bcd50-f9f6-50b1-beee-be6555e60070',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL22892',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 90258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-10',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Maxi Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Trendline BlueMotion',
 'year': 2017}
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL22892%27 HTTP/1.1" 200 None
2026-03-27 20:31:05 [auto1.be] INFO: Saving data for PL22892: {'auction_closing_time': 1774714619.0, 'created_time': 1774438333.090854, 'last_price_update_time': 1774643465.955805}
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PL22892') HTTP/1.1" 204 0
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: MS95161
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS95161%27 HTTP/1.1" 200 None
2026-03-27 20:31:06 [auto1.be] INFO: Scrape type for MS95161: 2
2026-03-27 20:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b58d27ce-e8ce-5792-81d0-cd7a038597ea with identifier: MS95161
2026-03-27 20:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b58d27ce-e8ce-5792-81d0-cd7a038597ea with scrape type 2
2026-03-27 20:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b58d27ce-e8ce-5792-81d0-cd7a038597ea with scrape type 2
2026-03-27 20:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b58d27ce-e8ce-5792-81d0-cd7a038597ea, identifier: MS95161
2026-03-27 20:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b58d27ce-e8ce-5792-81d0-cd7a038597ea with identifier: MS95161
2026-03-27 20:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b58d27ce-e8ce-5792-81d0-cd7a038597ea with identifier: MS95161
2026-03-27 20:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b58d27ce-e8ce-5792-81d0-cd7a038597ea with identifier: MS95161 to the API
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:27:46Z',
 'fuel_type': 'diesel',
 'id': 'b58d27ce-e8ce-5792-81d0-cd7a038597ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS95161',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 283127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-26',
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Advantage',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Advantage',
 'year': 2015}
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS95161%27 HTTP/1.1" 200 None
2026-03-27 20:31:06 [auto1.be] INFO: Saving data for MS95161: {'auction_closing_time': 1774715266.0, 'created_time': 1773348448.366148, 'last_price_update_time': 1774643466.430814}
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS95161') HTTP/1.1" 204 0
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: SE96369
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE96369%27 HTTP/1.1" 200 None
2026-03-27 20:31:06 [auto1.be] INFO: Scrape type for SE96369: 0
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-27 20:31:06 [auto1.be] INFO: Scrape type for UV50609: 0
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: JZ56411
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ56411%27 HTTP/1.1" 200 None
2026-03-27 20:31:06 [auto1.be] INFO: Scrape type for JZ56411: 0
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: XY49769
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: CX92013
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: NY73004
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY73004%27 HTTP/1.1" 200 None
2026-03-27 20:31:06 [auto1.be] INFO: Scrape type for NY73004: 0
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-27 20:31:06 [auto1.be] INFO: Scrape type for JV95971: 0
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: YB34897
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-27 20:31:06 [auto1.be] INFO: Scrape type for AX58227: 0
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: CB62754
2026-03-27 20:31:06 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-27 20:31:06 [scrapy.extensions.logstats] INFO: Crawled 35 pages (at 35 pages/min), scraped 76 items (at 76 items/min)
2026-03-27 20:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-27 20:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:07 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: MD83963
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD83963%27 HTTP/1.1" 200 None
2026-03-27 20:31:07 [auto1.be] INFO: Scrape type for MD83963: 0
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: KE03465
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: BR84534
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: TA85166
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA85166%27 HTTP/1.1" 200 None
2026-03-27 20:31:07 [auto1.be] INFO: Scrape type for TA85166: 0
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: ZW31488
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-27 20:31:07 [auto1.be] INFO: Scrape type for ET09366: 2
2026-03-27 20:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366
2026-03-27 20:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with scrape type 2
2026-03-27 20:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with scrape type 2
2026-03-27 20:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6, identifier: ET09366
2026-03-27 20:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366
2026-03-27 20:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366
2026-03-27 20:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366 to the API
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 341,
 'expiration_date': '2026-03-28T16:25:15Z',
 'fuel_type': 'hybrid',
 'id': '90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET09366',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 52799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T6 Plug-in Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2020}
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-27 20:31:07 [auto1.be] INFO: Saving data for ET09366: {'auction_closing_time': 1774715115.0, 'created_time': 1773833776.671054, 'last_price_update_time': 1774643467.822264}
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET09366') HTTP/1.1" 204 0
2026-03-27 20:31:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: JE01185
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: CE95179
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-27 20:31:07 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ80656%27 HTTP/1.1" 200 None
2026-03-27 20:31:07 [auto1.be] INFO: Scrape type for LJ80656: 2
2026-03-27 20:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21fbe423-c72b-5442-96a0-b006f4f7260d with identifier: LJ80656
2026-03-27 20:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21fbe423-c72b-5442-96a0-b006f4f7260d with scrape type 2
2026-03-27 20:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21fbe423-c72b-5442-96a0-b006f4f7260d with scrape type 2
2026-03-27 20:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 21fbe423-c72b-5442-96a0-b006f4f7260d, identifier: LJ80656
2026-03-27 20:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 21fbe423-c72b-5442-96a0-b006f4f7260d with identifier: LJ80656
2026-03-27 20:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 21fbe423-c72b-5442-96a0-b006f4f7260d with identifier: LJ80656
2026-03-27 20:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 21fbe423-c72b-5442-96a0-b006f4f7260d with identifier: LJ80656 to the API
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:27:40Z',
 'fuel_type': 'petrol',
 'id': '21fbe423-c72b-5442-96a0-b006f4f7260d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ80656',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 208635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ80656%27 HTTP/1.1" 200 None
2026-03-27 20:31:08 [auto1.be] INFO: Saving data for LJ80656: {'auction_closing_time': 1774715260.0, 'created_time': 1773134362.730398, 'last_price_update_time': 1774643468.312939}
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LJ80656') HTTP/1.1" 204 0
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-27 20:31:08 [auto1.be] INFO: Scrape type for GX61337: 0
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: JT01513
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: TD99955
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD99955%27 HTTP/1.1" 200 None
2026-03-27 20:31:08 [auto1.be] INFO: Scrape type for TD99955: 0
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-27 20:31:08 [auto1.be] INFO: Scrape type for XC64567: 0
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-27 20:31:08 [auto1.be] INFO: Scrape type for NG90127: 0
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: MW20724
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW20724%27 HTTP/1.1" 200 None
2026-03-27 20:31:08 [auto1.be] INFO: Scrape type for MW20724: 2
2026-03-27 20:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8f5d8b0-6bf5-5d07-b007-157a10c48963 with identifier: MW20724
2026-03-27 20:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8f5d8b0-6bf5-5d07-b007-157a10c48963 with scrape type 2
2026-03-27 20:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8f5d8b0-6bf5-5d07-b007-157a10c48963 with scrape type 2
2026-03-27 20:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c8f5d8b0-6bf5-5d07-b007-157a10c48963, identifier: MW20724
2026-03-27 20:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c8f5d8b0-6bf5-5d07-b007-157a10c48963 with identifier: MW20724
2026-03-27 20:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c8f5d8b0-6bf5-5d07-b007-157a10c48963 with identifier: MW20724
2026-03-27 20:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c8f5d8b0-6bf5-5d07-b007-157a10c48963 with identifier: MW20724 to the API
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:22:47Z',
 'fuel_type': 'diesel',
 'id': 'c8f5d8b0-6bf5-5d07-b007-157a10c48963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW20724',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 211942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-12',
 'seller_name': None,
 'title': 'BMW 2er 220d Active Tourer xDrive Basis',
 'transmission': 'automatic',
 'trim': 'xDrive Basis',
 'year': 2015}
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW20724%27 HTTP/1.1" 200 None
2026-03-27 20:31:08 [auto1.be] INFO: Saving data for MW20724: {'auction_closing_time': 1774714967.0, 'created_time': 1774438285.66996, 'last_price_update_time': 1774643468.769631}
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MW20724') HTTP/1.1" 204 0
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14526%27 HTTP/1.1" 200 None
2026-03-27 20:31:08 [auto1.be] INFO: Scrape type for ZH14526: 0
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-27 20:31:08 [auto1.be] INFO: Scrape type for TW64249: 0
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-27 20:31:08 [auto1.be] INFO: Found listing with ID: SD94146
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD94146%27 HTTP/1.1" 200 None
2026-03-27 20:31:08 [auto1.be] INFO: Scrape type for SD94146: 2
2026-03-27 20:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c49ba88-4a10-5bbb-a799-f2a2f5b3297e with identifier: SD94146
2026-03-27 20:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c49ba88-4a10-5bbb-a799-f2a2f5b3297e with scrape type 2
2026-03-27 20:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c49ba88-4a10-5bbb-a799-f2a2f5b3297e with scrape type 2
2026-03-27 20:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0c49ba88-4a10-5bbb-a799-f2a2f5b3297e, identifier: SD94146
2026-03-27 20:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0c49ba88-4a10-5bbb-a799-f2a2f5b3297e with identifier: SD94146
2026-03-27 20:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0c49ba88-4a10-5bbb-a799-f2a2f5b3297e with identifier: SD94146
2026-03-27 20:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0c49ba88-4a10-5bbb-a799-f2a2f5b3297e with identifier: SD94146 to the API
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:21:59Z',
 'fuel_type': 'diesel',
 'id': '0c49ba88-4a10-5bbb-a799-f2a2f5b3297e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD94146',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 87905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 2.0 Td4 HSE LUXURY',
 'transmission': 'automatic',
 'trim': 'HSE LUXURY',
 'year': 2018}
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD94146%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Saving data for SD94146: {'auction_closing_time': 1774714919.0, 'created_time': 1773135721.911059, 'last_price_update_time': 1774643469.273931}
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD94146') HTTP/1.1" 204 0
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: KA04949
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA04949%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Scrape type for KA04949: 2
2026-03-27 20:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1475262f-3fd4-599c-bd9d-e2dc844a4f64 with identifier: KA04949
2026-03-27 20:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1475262f-3fd4-599c-bd9d-e2dc844a4f64 with scrape type 2
2026-03-27 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1475262f-3fd4-599c-bd9d-e2dc844a4f64 with scrape type 2
2026-03-27 20:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1475262f-3fd4-599c-bd9d-e2dc844a4f64, identifier: KA04949
2026-03-27 20:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1475262f-3fd4-599c-bd9d-e2dc844a4f64 with identifier: KA04949
2026-03-27 20:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1475262f-3fd4-599c-bd9d-e2dc844a4f64 with identifier: KA04949
2026-03-27 20:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1475262f-3fd4-599c-bd9d-e2dc844a4f64 with identifier: KA04949 to the API
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:42:19Z',
 'fuel_type': 'diesel',
 'id': '1475262f-3fd4-599c-bd9d-e2dc844a4f64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA04949',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Optima',
 'odometer': 177897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-21',
 'seller_name': None,
 'title': 'Kia Optima 1.7 CRDi 20 Jahre Edition',
 'transmission': 'automatic',
 'trim': '20 Jahre Edition',
 'year': 2015}
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA04949%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Saving data for KA04949: {'auction_closing_time': 1774716139.0, 'created_time': 1774438237.762447, 'last_price_update_time': 1774643469.727191}
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KA04949') HTTP/1.1" 204 0
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: NK67799
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK67799%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Scrape type for NK67799: 0
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: XX33825
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX33825%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Scrape type for XX33825: 0
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: VH72500
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH72500%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Scrape type for VH72500: 0
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: PT71351
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT71351%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Scrape type for PT71351: 0
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: UK54549
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK54549%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Scrape type for UK54549: 0
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: ZY41289
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY41289%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Scrape type for ZY41289: 0
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: CW00167
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: KR25355
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR25355%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Scrape type for KR25355: 0
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: HY69206
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY69206%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Scrape type for HY69206: 0
2026-03-27 20:31:09 [auto1.be] INFO: Found listing with ID: ED19448
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED19448%27 HTTP/1.1" 200 None
2026-03-27 20:31:09 [auto1.be] INFO: Scrape type for ED19448: 2
2026-03-27 20:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c605139f-290e-54b8-84b0-ae6ad467a73b with identifier: ED19448
2026-03-27 20:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c605139f-290e-54b8-84b0-ae6ad467a73b with scrape type 2
2026-03-27 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c605139f-290e-54b8-84b0-ae6ad467a73b with scrape type 2
2026-03-27 20:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c605139f-290e-54b8-84b0-ae6ad467a73b, identifier: ED19448
2026-03-27 20:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c605139f-290e-54b8-84b0-ae6ad467a73b with identifier: ED19448
2026-03-27 20:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c605139f-290e-54b8-84b0-ae6ad467a73b with identifier: ED19448
2026-03-27 20:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c605139f-290e-54b8-84b0-ae6ad467a73b with identifier: ED19448 to the API
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:58Z',
 'fuel_type': 'petrol',
 'id': 'c605139f-290e-54b8-84b0-ae6ad467a73b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED19448',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 139439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-04',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED19448%27 HTTP/1.1" 200 None
2026-03-27 20:31:10 [auto1.be] INFO: Saving data for ED19448: {'auction_closing_time': 1774714678.0, 'created_time': 1773236502.175353, 'last_price_update_time': 1774643470.431131}
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED19448') HTTP/1.1" 204 0
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-27 20:31:10 [auto1.be] INFO: Scrape type for CS08088: 0
2026-03-27 20:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:10 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: NP41015
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: NG88652
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: HU32534
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32534%27 HTTP/1.1" 200 None
2026-03-27 20:31:10 [auto1.be] INFO: Scrape type for HU32534: 0
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-27 20:31:10 [auto1.be] INFO: Scrape type for JS25395: 0
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: GB32239
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB32239%27 HTTP/1.1" 200 None
2026-03-27 20:31:10 [auto1.be] INFO: Scrape type for GB32239: 0
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-27 20:31:10 [auto1.be] INFO: Scrape type for TT75307: 0
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: SJ92859
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: RB55358
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: SL08078
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-27 20:31:10 [auto1.be] INFO: Scrape type for SF38570: 0
2026-03-27 20:31:10 [auto1.be] INFO: Found listing with ID: GF08223
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF08223%27 HTTP/1.1" 200 None
2026-03-27 20:31:10 [auto1.be] INFO: Scrape type for GF08223: 2
2026-03-27 20:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3af0166-91f0-54b3-82f5-1644834ef792 with identifier: GF08223
2026-03-27 20:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3af0166-91f0-54b3-82f5-1644834ef792 with scrape type 2
2026-03-27 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3af0166-91f0-54b3-82f5-1644834ef792 with scrape type 2
2026-03-27 20:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3af0166-91f0-54b3-82f5-1644834ef792, identifier: GF08223
2026-03-27 20:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3af0166-91f0-54b3-82f5-1644834ef792 with identifier: GF08223
2026-03-27 20:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3af0166-91f0-54b3-82f5-1644834ef792 with identifier: GF08223
2026-03-27 20:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3af0166-91f0-54b3-82f5-1644834ef792 with identifier: GF08223 to the API
2026-03-27 20:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:58:26Z',
 'fuel_type': 'petrol',
 'id': 'c3af0166-91f0-54b3-82f5-1644834ef792',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF08223',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 191537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-07',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2014}
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF08223%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Saving data for GF08223: {'auction_closing_time': 1774717106.0, 'created_time': 1774006264.362032, 'last_price_update_time': 1774643471.140421}
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF08223') HTTP/1.1" 204 0
2026-03-27 20:31:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: PV92742
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV92742%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for PV92742: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for KG19380: 2
2026-03-27 20:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380
2026-03-27 20:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6a1cac-752f-55b3-a2e9-a12e622df169 with scrape type 2
2026-03-27 20:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6a1cac-752f-55b3-a2e9-a12e622df169 with scrape type 2
2026-03-27 20:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bc6a1cac-752f-55b3-a2e9-a12e622df169, identifier: KG19380
2026-03-27 20:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380
2026-03-27 20:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380
2026-03-27 20:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380 to the API
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:36:44Z',
 'fuel_type': 'diesel',
 'id': 'bc6a1cac-752f-55b3-a2e9-a12e622df169',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG19380',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 33710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-26',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Stepway II',
 'transmission': 'manual',
 'trim': 'Stepway II',
 'year': 2012}
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Saving data for KG19380: {'auction_closing_time': 1774715804.0, 'created_time': 1774557068.228256, 'last_price_update_time': 1774643471.609895}
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG19380') HTTP/1.1" 204 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: TE49722
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for TH53375: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: WY74767
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY74767%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for WY74767: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for WA10715: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: PU36315
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: NN37079
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: WZ44217
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for XJ95743: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX12355%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for EX12355: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: LB88275
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB88275%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for LB88275: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB29078%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for NB29078: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: NR75863
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC37293%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for VC37293: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: GJ44725
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ44725%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for GJ44725: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: WW09549
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW09549%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for WW09549: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for VW32861: 1
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: JT16310
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT16310%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for JT16310: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: KZ62896
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ62896%27 HTTP/1.1" 200 None
2026-03-27 20:31:11 [auto1.be] INFO: Scrape type for KZ62896: 0
2026-03-27 20:31:11 [auto1.be] INFO: Found listing with ID: SP19111
2026-03-27 20:31:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW32861/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:12 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:12 [auto1.be] INFO: Found listing with ID: PM94019
2026-03-27 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM94019%27 HTTP/1.1" 200 None
2026-03-27 20:31:12 [auto1.be] INFO: Scrape type for PM94019: 0
2026-03-27 20:31:12 [auto1.be] INFO: Found listing with ID: BF62281
2026-03-27 20:31:12 [auto1.be] INFO: Found listing with ID: KM06752
2026-03-27 20:31:12 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-27 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-27 20:31:12 [auto1.be] INFO: Scrape type for YU72813: 1
2026-03-27 20:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:12 [auto1.be] INFO: Found listing with ID: CP72825
2026-03-27 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP72825%27 HTTP/1.1" 200 None
2026-03-27 20:31:12 [auto1.be] INFO: Scrape type for CP72825: 2
2026-03-27 20:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4f58fe5-ff19-59ff-9805-77b175a9d27e with identifier: CP72825
2026-03-27 20:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4f58fe5-ff19-59ff-9805-77b175a9d27e with scrape type 2
2026-03-27 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4f58fe5-ff19-59ff-9805-77b175a9d27e with scrape type 2
2026-03-27 20:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4f58fe5-ff19-59ff-9805-77b175a9d27e, identifier: CP72825
2026-03-27 20:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4f58fe5-ff19-59ff-9805-77b175a9d27e with identifier: CP72825
2026-03-27 20:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4f58fe5-ff19-59ff-9805-77b175a9d27e with identifier: CP72825
2026-03-27 20:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4f58fe5-ff19-59ff-9805-77b175a9d27e with identifier: CP72825 to the API
2026-03-27 20:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:23Z',
 'fuel_type': 'diesel',
 'id': 'e4f58fe5-ff19-59ff-9805-77b175a9d27e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP72825',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 141753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-19',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2016}
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP72825%27 HTTP/1.1" 200 None
2026-03-27 20:31:13 [auto1.be] INFO: Saving data for CP72825: {'auction_closing_time': 1774713863.0, 'created_time': 1774438334.236621, 'last_price_update_time': 1774643473.199094}
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP72825') HTTP/1.1" 204 0
2026-03-27 20:31:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: FY96081
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY96081%27 HTTP/1.1" 200 None
2026-03-27 20:31:13 [auto1.be] INFO: Scrape type for FY96081: 0
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: YF72267
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF72267%27 HTTP/1.1" 200 None
2026-03-27 20:31:13 [auto1.be] INFO: Scrape type for YF72267: 2
2026-03-27 20:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e14321c-4942-5add-8784-ca1fe4591eaa with identifier: YF72267
2026-03-27 20:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e14321c-4942-5add-8784-ca1fe4591eaa with scrape type 2
2026-03-27 20:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e14321c-4942-5add-8784-ca1fe4591eaa with scrape type 2
2026-03-27 20:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e14321c-4942-5add-8784-ca1fe4591eaa, identifier: YF72267
2026-03-27 20:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e14321c-4942-5add-8784-ca1fe4591eaa with identifier: YF72267
2026-03-27 20:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e14321c-4942-5add-8784-ca1fe4591eaa with identifier: YF72267
2026-03-27 20:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e14321c-4942-5add-8784-ca1fe4591eaa with identifier: YF72267 to the API
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:04:47Z',
 'fuel_type': 'petrol',
 'id': '4e14321c-4942-5add-8784-ca1fe4591eaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF72267',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 77787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-17',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Maxi Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Trendline BlueMotion',
 'year': 2019}
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF72267%27 HTTP/1.1" 200 None
2026-03-27 20:31:13 [auto1.be] INFO: Saving data for YF72267: {'auction_closing_time': 1774713887.0, 'created_time': 1773136428.971308, 'last_price_update_time': 1774643473.703685}
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YF72267') HTTP/1.1" 204 0
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: KZ21578
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: PS35692
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS35692%27 HTTP/1.1" 200 None
2026-03-27 20:31:13 [auto1.be] INFO: Scrape type for PS35692: 0
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: PJ29729
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: SL54877
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL54877%27 HTTP/1.1" 200 None
2026-03-27 20:31:13 [auto1.be] INFO: Scrape type for SL54877: 0
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: ZY27857
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: NX65189
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-27 20:31:13 [auto1.be] INFO: Scrape type for CN29269: 0
2026-03-27 20:31:13 [auto1.be] INFO: Found listing with ID: NB01852
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB01852%27 HTTP/1.1" 200 None
2026-03-27 20:31:13 [auto1.be] INFO: Scrape type for NB01852: 2
2026-03-27 20:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59db28d9-8937-5b3d-9614-62527033cb08 with identifier: NB01852
2026-03-27 20:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59db28d9-8937-5b3d-9614-62527033cb08 with scrape type 2
2026-03-27 20:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59db28d9-8937-5b3d-9614-62527033cb08 with scrape type 2
2026-03-27 20:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 59db28d9-8937-5b3d-9614-62527033cb08, identifier: NB01852
2026-03-27 20:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 59db28d9-8937-5b3d-9614-62527033cb08 with identifier: NB01852
2026-03-27 20:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 59db28d9-8937-5b3d-9614-62527033cb08 with identifier: NB01852
2026-03-27 20:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 59db28d9-8937-5b3d-9614-62527033cb08 with identifier: NB01852 to the API
2026-03-27 20:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:46:48Z',
 'fuel_type': 'hybrid',
 'id': '59db28d9-8937-5b3d-9614-62527033cb08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB01852',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 60281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-04',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI iV Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2026-03-27 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB01852%27 HTTP/1.1" 200 None
2026-03-27 20:31:14 [auto1.be] INFO: Saving data for NB01852: {'auction_closing_time': 1774716408.0, 'created_time': 1773234065.787551, 'last_price_update_time': 1774643474.172147}
2026-03-27 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB01852') HTTP/1.1" 204 0
2026-03-27 20:31:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:14 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-27 20:31:14 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-27 20:31:14 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-27 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD01441%27 HTTP/1.1" 200 None
2026-03-27 20:31:14 [auto1.be] INFO: Scrape type for KD01441: 2
2026-03-27 20:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd743dc-3036-5603-a49b-b94cbcac5b4f with identifier: KD01441
2026-03-27 20:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd743dc-3036-5603-a49b-b94cbcac5b4f with scrape type 2
2026-03-27 20:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd743dc-3036-5603-a49b-b94cbcac5b4f with scrape type 2
2026-03-27 20:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7fd743dc-3036-5603-a49b-b94cbcac5b4f, identifier: KD01441
2026-03-27 20:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7fd743dc-3036-5603-a49b-b94cbcac5b4f with identifier: KD01441
2026-03-27 20:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7fd743dc-3036-5603-a49b-b94cbcac5b4f with identifier: KD01441
2026-03-27 20:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7fd743dc-3036-5603-a49b-b94cbcac5b4f with identifier: KD01441 to the API
2026-03-27 20:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:08:07Z',
 'fuel_type': 'petrol',
 'id': '7fd743dc-3036-5603-a49b-b94cbcac5b4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD01441',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 120909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-17',
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD01441%27 HTTP/1.1" 200 None
2026-03-27 20:31:15 [auto1.be] INFO: Saving data for KD01441: {'auction_closing_time': 1774714087.0, 'created_time': 1774438231.66082, 'last_price_update_time': 1774643475.063543}
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KD01441') HTTP/1.1" 204 0
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: WN30379
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: JX70748
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX70748%27 HTTP/1.1" 200 None
2026-03-27 20:31:15 [auto1.be] INFO: Scrape type for JX70748: 0
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-27 20:31:15 [auto1.be] INFO: Scrape type for XD36076: 2
2026-03-27 20:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076
2026-03-27 20:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d84f2b5-e901-529d-956f-4493e0794e65 with scrape type 2
2026-03-27 20:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d84f2b5-e901-529d-956f-4493e0794e65 with scrape type 2
2026-03-27 20:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d84f2b5-e901-529d-956f-4493e0794e65, identifier: XD36076
2026-03-27 20:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076
2026-03-27 20:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076
2026-03-27 20:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076 to the API
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:21:33Z',
 'fuel_type': 'diesel',
 'id': '6d84f2b5-e901-529d-956f-4493e0794e65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD36076',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 170077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-22',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-27 20:31:15 [auto1.be] INFO: Saving data for XD36076: {'auction_closing_time': 1774714893.0, 'created_time': 1773923008.308945, 'last_price_update_time': 1774643475.460077}
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XD36076') HTTP/1.1" 204 0
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: MX12092
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX12092%27 HTTP/1.1" 200 None
2026-03-27 20:31:15 [auto1.be] INFO: Scrape type for MX12092: 0
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: TP88301
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP88301%27 HTTP/1.1" 200 None
2026-03-27 20:31:15 [auto1.be] INFO: Scrape type for TP88301: 2
2026-03-27 20:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47044c8c-8851-5a14-971f-f9f5799fac1f with identifier: TP88301
2026-03-27 20:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47044c8c-8851-5a14-971f-f9f5799fac1f with scrape type 2
2026-03-27 20:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47044c8c-8851-5a14-971f-f9f5799fac1f with scrape type 2
2026-03-27 20:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 47044c8c-8851-5a14-971f-f9f5799fac1f, identifier: TP88301
2026-03-27 20:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 47044c8c-8851-5a14-971f-f9f5799fac1f with identifier: TP88301
2026-03-27 20:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 47044c8c-8851-5a14-971f-f9f5799fac1f with identifier: TP88301
2026-03-27 20:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 47044c8c-8851-5a14-971f-f9f5799fac1f with identifier: TP88301 to the API
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-28T16:20:35Z',
 'fuel_type': 'hybrid',
 'id': '47044c8c-8851-5a14-971f-f9f5799fac1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP88301',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 199225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-22',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2021}
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP88301%27 HTTP/1.1" 200 None
2026-03-27 20:31:15 [auto1.be] INFO: Saving data for TP88301: {'auction_closing_time': 1774714835.0, 'created_time': 1774438286.435714, 'last_price_update_time': 1774643475.865952}
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TP88301') HTTP/1.1" 204 0
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: FA45415
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: DS89988
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-27 20:31:15 [auto1.be] INFO: Scrape type for XV14848: 0
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: HY85639
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: RP50395
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-27 20:31:15 [auto1.be] INFO: Found listing with ID: VB86156
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB86156%27 HTTP/1.1" 200 None
2026-03-27 20:31:15 [auto1.be] INFO: Scrape type for VB86156: 2
2026-03-27 20:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb1a0cd0-de2f-5624-906c-907a4acbd47b with identifier: VB86156
2026-03-27 20:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb1a0cd0-de2f-5624-906c-907a4acbd47b with scrape type 2
2026-03-27 20:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb1a0cd0-de2f-5624-906c-907a4acbd47b with scrape type 2
2026-03-27 20:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eb1a0cd0-de2f-5624-906c-907a4acbd47b, identifier: VB86156
2026-03-27 20:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eb1a0cd0-de2f-5624-906c-907a4acbd47b with identifier: VB86156
2026-03-27 20:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eb1a0cd0-de2f-5624-906c-907a4acbd47b with identifier: VB86156
2026-03-27 20:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eb1a0cd0-de2f-5624-906c-907a4acbd47b with identifier: VB86156 to the API
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:26Z',
 'fuel_type': 'diesel',
 'id': 'eb1a0cd0-de2f-5624-906c-907a4acbd47b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB86156',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 223750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB86156%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Saving data for VB86156: {'auction_closing_time': 1774716506.0, 'created_time': 1774438244.349892, 'last_price_update_time': 1774643476.284746}
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VB86156') HTTP/1.1" 204 0
2026-03-27 20:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: XM97787
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: HV83812
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HV83812%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Scrape type for HV83812: 0
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: TR57009
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: FV70837
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: TB39644
2026-03-27 20:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU72813/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:16 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Scrape type for UM90025: 0
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Scrape type for WE68493: 0
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: KN95173
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP75874%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Scrape type for VP75874: 0
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: TU34385
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: UT50756
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT50756%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Scrape type for UT50756: 0
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: RB21597
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: ZM96172
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM96172%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Scrape type for ZM96172: 0
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: DC36147
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: FS22519
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS22519%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Scrape type for FS22519: 0
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: TP45390
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP45390%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Scrape type for TP45390: 0
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM47313%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Scrape type for PM47313: 0
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA19213%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Scrape type for FA19213: 0
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: TV03405
2026-03-27 20:31:16 [auto1.be] INFO: Found listing with ID: SJ45947
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ45947%27 HTTP/1.1" 200 None
2026-03-27 20:31:16 [auto1.be] INFO: Scrape type for SJ45947: 2
2026-03-27 20:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea9a339a-5d9c-5ffc-b17f-44f7c8412cf3 with identifier: SJ45947
2026-03-27 20:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea9a339a-5d9c-5ffc-b17f-44f7c8412cf3 with scrape type 2
2026-03-27 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea9a339a-5d9c-5ffc-b17f-44f7c8412cf3 with scrape type 2
2026-03-27 20:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ea9a339a-5d9c-5ffc-b17f-44f7c8412cf3, identifier: SJ45947
2026-03-27 20:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ea9a339a-5d9c-5ffc-b17f-44f7c8412cf3 with identifier: SJ45947
2026-03-27 20:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ea9a339a-5d9c-5ffc-b17f-44f7c8412cf3 with identifier: SJ45947
2026-03-27 20:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ea9a339a-5d9c-5ffc-b17f-44f7c8412cf3 with identifier: SJ45947 to the API
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:34:10Z',
 'fuel_type': 'diesel',
 'id': 'ea9a339a-5d9c-5ffc-b17f-44f7c8412cf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ45947',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 323601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ45947%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Saving data for SJ45947: {'auction_closing_time': 1774715650.0, 'created_time': 1774438310.157465, 'last_price_update_time': 1774643477.064146}
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ45947') HTTP/1.1" 204 0
2026-03-27 20:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: PT93863
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for DL13581: 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: XM22406
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM22406%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for XM22406: 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: UT96766
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF11904%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for XF11904: 2
2026-03-27 20:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7417e7b-4d5c-56ce-a513-52c101391bf7 with identifier: XF11904
2026-03-27 20:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7417e7b-4d5c-56ce-a513-52c101391bf7 with scrape type 2
2026-03-27 20:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7417e7b-4d5c-56ce-a513-52c101391bf7 with scrape type 2
2026-03-27 20:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f7417e7b-4d5c-56ce-a513-52c101391bf7, identifier: XF11904
2026-03-27 20:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f7417e7b-4d5c-56ce-a513-52c101391bf7 with identifier: XF11904
2026-03-27 20:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f7417e7b-4d5c-56ce-a513-52c101391bf7 with identifier: XF11904
2026-03-27 20:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f7417e7b-4d5c-56ce-a513-52c101391bf7 with identifier: XF11904 to the API
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:08:43Z',
 'fuel_type': 'diesel',
 'id': 'f7417e7b-4d5c-56ce-a513-52c101391bf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF11904',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 93950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2020}
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF11904%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Saving data for XF11904: {'auction_closing_time': 1774714123.0, 'created_time': 1773348282.285996, 'last_price_update_time': 1774643477.590091}
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XF11904') HTTP/1.1" 204 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: WC57902
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC57902%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for WC57902: 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: ER60484
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER60484%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for ER60484: 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: MB05626
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB05626%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for MB05626: 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: NF63760
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: TC10006
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC10006%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for TC10006: 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: HB89666
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: HZ06807
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ06807%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for HZ06807: 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: HU32342
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: TC70277
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC70277%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for TC70277: 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: RB45642
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB45642%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for RB45642: 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for HE95946: 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: AD25511
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD25511%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for AD25511: 0
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-27 20:31:17 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15920%27 HTTP/1.1" 200 None
2026-03-27 20:31:17 [auto1.be] INFO: Scrape type for MB15920: 0
2026-03-27 20:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW32861> (referer: https://www.auto1.com/v1/car-details-view/VW32861/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861
2026-03-27 20:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a816a3a2-a052-5345-8f53-a1206ac57403 with scrape type 1
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a816a3a2-a052-5345-8f53-a1206ac57403
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_5d57fd57dcad77b57e7ea63bec201d3a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_5d57fd57dcad77b57e7ea63bec201d3a.jpg not downloaded yet
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_f724c85e86a549cb40db7c43eefa8b73.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_f724c85e86a549cb40db7c43eefa8b73.jpg not downloaded yet
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_7552d3e9386400928685a785ca31bf6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_7552d3e9386400928685a785ca31bf6a.jpg not downloaded yet
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_940a358a9fdc0ba1db0baf7e9f76faa4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_940a358a9fdc0ba1db0baf7e9f76faa4.jpg not downloaded yet
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_04459918016620f34442f8e78203c4e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_04459918016620f34442f8e78203c4e6.jpg not downloaded yet
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_d6b671d1d4d2c8f6ce37f1dc43a48d26.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_d6b671d1d4d2c8f6ce37f1dc43a48d26.jpg not downloaded yet
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_d28289a7d3350885593e04b3ea55ae88.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_d28289a7d3350885593e04b3ea55ae88.jpg not downloaded yet
2026-03-27 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_5d57fd57dcad77b57e7ea63bec201d3a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_e6d89b918881ebfff92697b41bcdd1bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_e6d89b918881ebfff92697b41bcdd1bc.jpg not downloaded yet
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_0b23ca35d42982ce91bee607e9200336.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_0b23ca35d42982ce91bee607e9200336.jpg not downloaded yet
2026-03-27 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_940a358a9fdc0ba1db0baf7e9f76faa4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_7552d3e9386400928685a785ca31bf6a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_f724c85e86a549cb40db7c43eefa8b73.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_fe5253945f7ef1ad30cad3cc3d8ac9f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_fe5253945f7ef1ad30cad3cc3d8ac9f3.jpg not downloaded yet
2026-03-27 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_04459918016620f34442f8e78203c4e6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3680fe010>
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_5d57fd57dcad77b57e7ea63bec201d3a.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_5d57fd57dcad77b57e7ea63bec201d3a.jpg saved to cache
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a816a3a2-a052-5345-8f53-a1206ac57403
2026-03-27 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_d28289a7d3350885593e04b3ea55ae88.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_0b23ca35d42982ce91bee607e9200336.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU72813> (referer: https://www.auto1.com/v1/car-details-view/YU72813/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534b0290>
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_940a358a9fdc0ba1db0baf7e9f76faa4.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_940a358a9fdc0ba1db0baf7e9f76faa4.jpg saved to cache
2026-03-27 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a816a3a2-a052-5345-8f53-a1206ac57403
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353596510>
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_7552d3e9386400928685a785ca31bf6a.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_7552d3e9386400928685a785ca31bf6a.jpg saved to cache
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a816a3a2-a052-5345-8f53-a1206ac57403
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf4a90>
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_f724c85e86a549cb40db7c43eefa8b73.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_f724c85e86a549cb40db7c43eefa8b73.jpg saved to cache
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a816a3a2-a052-5345-8f53-a1206ac57403
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35340c910>
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_04459918016620f34442f8e78203c4e6.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_04459918016620f34442f8e78203c4e6.jpg saved to cache
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a816a3a2-a052-5345-8f53-a1206ac57403
2026-03-27 20:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_fe5253945f7ef1ad30cad3cc3d8ac9f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_d6b671d1d4d2c8f6ce37f1dc43a48d26.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a51190>
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_d28289a7d3350885593e04b3ea55ae88.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_d28289a7d3350885593e04b3ea55ae88.jpg saved to cache
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a816a3a2-a052-5345-8f53-a1206ac57403
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b5e4d0>
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_0b23ca35d42982ce91bee607e9200336.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_0b23ca35d42982ce91bee607e9200336.jpg saved to cache
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a816a3a2-a052-5345-8f53-a1206ac57403
2026-03-27 20:31:19 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813
2026-03-27 20:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a76ec79-767d-54a2-9645-fc632314dab7 with scrape type 1
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a76ec79-767d-54a2-9645-fc632314dab7
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fcc%252Fddcc12901d0e18c5fadb3f8d0260e362%252Fpa%252FYU72813_be3d8f7df93022e67e207c75adb51658.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_be3d8f7df93022e67e207c75adb51658.jpg already downloaded
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fcc%252Fddcc12901d0e18c5fadb3f8d0260e362%252Fpa%252FYU72813_96472cc9cb0b257b457fc5ed0ac0ba3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_96472cc9cb0b257b457fc5ed0ac0ba3f.jpg already downloaded
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fcc%252Fddcc12901d0e18c5fadb3f8d0260e362%252Fpa%252FYU72813_ff713b651b24822b1f9390bd41a48b60.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_ff713b651b24822b1f9390bd41a48b60.jpg already downloaded
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fcc%252Fddcc12901d0e18c5fadb3f8d0260e362%252Fpa%252FYU72813_04e6890646e0badea97b0fc6b6dbcc33.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_04e6890646e0badea97b0fc6b6dbcc33.jpg already downloaded
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fcc%252Fddcc12901d0e18c5fadb3f8d0260e362%252Fpa%252FYU72813_4373649f6a014c988e2f3e0b8ca58eee.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_4373649f6a014c988e2f3e0b8ca58eee.jpg already downloaded
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fcc%252Fddcc12901d0e18c5fadb3f8d0260e362%252Fpa%252FYU72813_e6de418f9f525b6db09b275f96f81660.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_e6de418f9f525b6db09b275f96f81660.jpg already downloaded
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fcc%252Fddcc12901d0e18c5fadb3f8d0260e362%252Fpa%252FYU72813_a3c9d2e9df707122372d351405cc8554.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_a3c9d2e9df707122372d351405cc8554.jpg already downloaded
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fcc%252Fddcc12901d0e18c5fadb3f8d0260e362%252Fpa%252FYU72813_ba0b25ddd10879c8183d738708b5cd3d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_ba0b25ddd10879c8183d738708b5cd3d.jpg already downloaded
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fcc%252Fddcc12901d0e18c5fadb3f8d0260e362%252Fpa%252FYU72813_42537e080ccbb9e9577915489d6aa7d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_42537e080ccbb9e9577915489d6aa7d6.jpg already downloaded
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fcc%252Fddcc12901d0e18c5fadb3f8d0260e362%252Fpa%252FYU72813_d79326376a2fd96f61a34941dd406708.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_d79326376a2fd96f61a34941dd406708.jpg already downloaded
2026-03-27 20:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a76ec79-767d-54a2-9645-fc632314dab7, identifier: YU72813
2026-03-27 20:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813
2026-03-27 20:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813
2026-03-27 20:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813 to the API
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU72813>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:18:00Z',
 'fuel_type': 'diesel',
 'id': '0a76ec79-767d-54a2-9645-fc632314dab7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU72813',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 187635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_be3d8f7df93022e67e207c75adb51658.jpg',
                'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_96472cc9cb0b257b457fc5ed0ac0ba3f.jpg',
                'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_ff713b651b24822b1f9390bd41a48b60.jpg',
                'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_04e6890646e0badea97b0fc6b6dbcc33.jpg',
                'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_4373649f6a014c988e2f3e0b8ca58eee.jpg',
                'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_e6de418f9f525b6db09b275f96f81660.jpg',
                'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_a3c9d2e9df707122372d351405cc8554.jpg',
                'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_ba0b25ddd10879c8183d738708b5cd3d.jpg',
                'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_42537e080ccbb9e9577915489d6aa7d6.jpg',
                'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_d79326376a2fd96f61a34941dd406708.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a76ec79-767d-54a2-9645-fc632314dab7/0a76ec79-767d-54a2-9645-fc632314dab7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_be3d8f7df93022e67e207c75adb51658.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a76ec79-767d-54a2-9645-fc632314dab7/0a76ec79-767d-54a2-9645-fc632314dab7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847970,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_96472cc9cb0b257b457fc5ed0ac0ba3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a76ec79-767d-54a2-9645-fc632314dab7/0a76ec79-767d-54a2-9645-fc632314dab7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_ff713b651b24822b1f9390bd41a48b60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a76ec79-767d-54a2-9645-fc632314dab7/0a76ec79-767d-54a2-9645-fc632314dab7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626170,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_04e6890646e0badea97b0fc6b6dbcc33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a76ec79-767d-54a2-9645-fc632314dab7/0a76ec79-767d-54a2-9645-fc632314dab7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2873801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_4373649f6a014c988e2f3e0b8ca58eee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a76ec79-767d-54a2-9645-fc632314dab7/0a76ec79-767d-54a2-9645-fc632314dab7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_e6de418f9f525b6db09b275f96f81660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a76ec79-767d-54a2-9645-fc632314dab7/0a76ec79-767d-54a2-9645-fc632314dab7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_a3c9d2e9df707122372d351405cc8554.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a76ec79-767d-54a2-9645-fc632314dab7/0a76ec79-767d-54a2-9645-fc632314dab7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2640314,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_ba0b25ddd10879c8183d738708b5cd3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a76ec79-767d-54a2-9645-fc632314dab7/0a76ec79-767d-54a2-9645-fc632314dab7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2623929,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_42537e080ccbb9e9577915489d6aa7d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a76ec79-767d-54a2-9645-fc632314dab7/0a76ec79-767d-54a2-9645-fc632314dab7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2757892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/cc/ddcc12901d0e18c5fadb3f8d0260e362/pa/YU72813_d79326376a2fd96f61a34941dd406708.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2018}
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [auto1.be] INFO: Saving data for YU72813: {'created_time': 1774643479.7543, 'last_price_update_time': 1774643479.754312, 'auction_closing_time': 1774714680.0}
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU72813') HTTP/1.1" 204 0
2026-03-27 20:31:19 [auto1.be] INFO: Found listing with ID: JD48468
2026-03-27 20:31:19 [auto1.be] INFO: Found listing with ID: MN54564
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN54564%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [auto1.be] INFO: Scrape type for MN54564: 0
2026-03-27 20:31:19 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-27 20:31:19 [auto1.be] INFO: Scrape type for CH83928: 2
2026-03-27 20:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928
2026-03-27 20:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46836ba0-dcc0-5028-a621-e5011f6d3c7b with scrape type 2
2026-03-27 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46836ba0-dcc0-5028-a621-e5011f6d3c7b with scrape type 2
2026-03-27 20:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46836ba0-dcc0-5028-a621-e5011f6d3c7b, identifier: CH83928
2026-03-27 20:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_e6d89b918881ebfff92697b41bcdd1bc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928
2026-03-27 20:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-27 20:31:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928
2026-03-27 20:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928 to the API
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:22:56Z',
 'fuel_type': 'diesel',
 'id': '46836ba0-dcc0-5028-a621-e5011f6d3c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH83928',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 165799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-09',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2017}
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Saving data for CH83928: {'auction_closing_time': 1774714976.0, 'created_time': 1774557029.48714, 'last_price_update_time': 1774643480.370334}
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH83928') HTTP/1.1" 204 0
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: JR78742
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: AN55129
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN55129%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for AN55129: 0
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: TK17368
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK17368%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for TK17368: 0
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: VD47423
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD47423%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for VD47423: 0
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: HH31888
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH31888%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for HH31888: 0
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for KK24955: 0
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for UA82763: 0
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for RK42644: 1
2026-03-27 20:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353693dd0>
2026-03-27 20:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_fe5253945f7ef1ad30cad3cc3d8ac9f3.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_fe5253945f7ef1ad30cad3cc3d8ac9f3.jpg saved to cache
2026-03-27 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a816a3a2-a052-5345-8f53-a1206ac57403
2026-03-27 20:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf42d0>
2026-03-27 20:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_d6b671d1d4d2c8f6ce37f1dc43a48d26.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_d6b671d1d4d2c8f6ce37f1dc43a48d26.jpg saved to cache
2026-03-27 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a816a3a2-a052-5345-8f53-a1206ac57403
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: VE77274
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for MA06269: 0
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for TS87931: 0
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: AN88473
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: DD10151
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: TH59922
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: VF82058
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF82058%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for VF82058: 0
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for FP68376: 0
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: CZ74735
2026-03-27 20:31:20 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-27 20:31:20 [auto1.be] INFO: Scrape type for FT96499: 2
2026-03-27 20:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499
2026-03-27 20:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ecd41b0-500f-5767-8029-5f9550729423 with scrape type 2
2026-03-27 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ecd41b0-500f-5767-8029-5f9550729423 with scrape type 2
2026-03-27 20:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ecd41b0-500f-5767-8029-5f9550729423, identifier: FT96499
2026-03-27 20:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499
2026-03-27 20:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499
2026-03-27 20:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499 to the API
2026-03-27 20:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:37:06Z',
 'fuel_type': 'petrol',
 'id': '2ecd41b0-500f-5767-8029-5f9550729423',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT96499',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 25850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-24',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2020}
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-27 20:31:21 [auto1.be] INFO: Saving data for FT96499: {'auction_closing_time': 1774715826.0, 'created_time': 1774557069.442864, 'last_price_update_time': 1774643481.144147}
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FT96499') HTTP/1.1" 204 0
2026-03-27 20:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a10350>
2026-03-27 20:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F58%252Fb358ea0748ca684b105ec25cb2d01c99%252Fpa%252FVW32861_e6d89b918881ebfff92697b41bcdd1bc.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_e6d89b918881ebfff92697b41bcdd1bc.jpg saved to cache
2026-03-27 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a816a3a2-a052-5345-8f53-a1206ac57403
2026-03-27 20:31:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a816a3a2-a052-5345-8f53-a1206ac57403, skipping ID generation
2026-03-27 20:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a816a3a2-a052-5345-8f53-a1206ac57403 with scrape type 1
2026-03-27 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a816a3a2-a052-5345-8f53-a1206ac57403 sending to next pipeline
2026-03-27 20:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a816a3a2-a052-5345-8f53-a1206ac57403, identifier: VW32861
2026-03-27 20:31:21 [auto1.be] INFO: Found listing with ID: EC58285
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EC58285%27 HTTP/1.1" 200 None
2026-03-27 20:31:21 [auto1.be] INFO: Scrape type for EC58285: 0
2026-03-27 20:31:21 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-27 20:31:21 [auto1.be] INFO: Scrape type for EX63844: 2
2026-03-27 20:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844
2026-03-27 20:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4e894fc-13c8-5b66-8f67-1e74190f7c30 with scrape type 2
2026-03-27 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4e894fc-13c8-5b66-8f67-1e74190f7c30 with scrape type 2
2026-03-27 20:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4e894fc-13c8-5b66-8f67-1e74190f7c30, identifier: EX63844
2026-03-27 20:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861
2026-03-27 20:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861
2026-03-27 20:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861 to the API
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_e6d89b918881ebfff92697b41bcdd1bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 52,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:49:34Z',
 'fuel_type': 'hybrid',
 'id': 'a816a3a2-a052-5345-8f53-a1206ac57403',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW32861',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 50169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_5d57fd57dcad77b57e7ea63bec201d3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_f724c85e86a549cb40db7c43eefa8b73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_7552d3e9386400928685a785ca31bf6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_940a358a9fdc0ba1db0baf7e9f76faa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_04459918016620f34442f8e78203c4e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_d6b671d1d4d2c8f6ce37f1dc43a48d26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_d28289a7d3350885593e04b3ea55ae88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_e6d89b918881ebfff92697b41bcdd1bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_0b23ca35d42982ce91bee607e9200336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a816a3a2-a052-5345-8f53-a1206ac57403/a816a3a2-a052-5345-8f53-a1206ac57403_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/58/b358ea0748ca684b105ec25cb2d01c99/pa/VW32861_fe5253945f7ef1ad30cad3cc3d8ac9f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2017}
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-27 20:31:21 [auto1.be] INFO: Saving data for VW32861: {'created_time': 1774643481.780312, 'last_price_update_time': 1774643481.780322, 'auction_closing_time': 1774716574.0}
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW32861') HTTP/1.1" 204 0
2026-03-27 20:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844
2026-03-27 20:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844
2026-03-27 20:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844 to the API
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:10:31Z',
 'fuel_type': 'diesel',
 'id': 'f4e894fc-13c8-5b66-8f67-1e74190f7c30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX63844',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 129189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2019}
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-27 20:31:22 [auto1.be] INFO: Saving data for EX63844: {'auction_closing_time': 1774714231.0, 'created_time': 1774557063.948719, 'last_price_update_time': 1774643482.08471}
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX63844') HTTP/1.1" 204 0
2026-03-27 20:31:22 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-27 20:31:22 [auto1.be] INFO: Scrape type for HH62001: 0
2026-03-27 20:31:22 [auto1.be] INFO: Found listing with ID: UR73275
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR73275%27 HTTP/1.1" 200 None
2026-03-27 20:31:22 [auto1.be] INFO: Scrape type for UR73275: 0
2026-03-27 20:31:22 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-27 20:31:22 [auto1.be] INFO: Scrape type for RF74485: 0
2026-03-27 20:31:22 [auto1.be] INFO: Found listing with ID: ZM59718
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM59718%27 HTTP/1.1" 200 None
2026-03-27 20:31:22 [auto1.be] INFO: Scrape type for ZM59718: 0
2026-03-27 20:31:22 [auto1.be] INFO: Found listing with ID: YZ90167
2026-03-27 20:31:22 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT59149%27 HTTP/1.1" 200 None
2026-03-27 20:31:22 [auto1.be] INFO: Scrape type for HT59149: 0
2026-03-27 20:31:22 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-27 20:31:22 [auto1.be] INFO: Found listing with ID: VS47672
2026-03-27 20:31:22 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-27 20:31:22 [auto1.be] INFO: Found listing with ID: BZ90658
2026-03-27 20:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK42644/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:22 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:22 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Scrape type for FW88759: 0
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: HN52312
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN52312%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Scrape type for HN52312: 0
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: CA69556
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA69556%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Scrape type for CA69556: 0
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: BP57356
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP57356%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Scrape type for BP57356: 0
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: JZ31869
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: YK49914
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Scrape type for ZG73435: 0
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: ET01802
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET01802%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Scrape type for ET01802: 2
2026-03-27 20:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea44d9c-ab58-51f5-869d-93ab6d414811 with identifier: ET01802
2026-03-27 20:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea44d9c-ab58-51f5-869d-93ab6d414811 with scrape type 2
2026-03-27 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ea44d9c-ab58-51f5-869d-93ab6d414811 with scrape type 2
2026-03-27 20:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ea44d9c-ab58-51f5-869d-93ab6d414811, identifier: ET01802
2026-03-27 20:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ea44d9c-ab58-51f5-869d-93ab6d414811 with identifier: ET01802
2026-03-27 20:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ea44d9c-ab58-51f5-869d-93ab6d414811 with identifier: ET01802
2026-03-27 20:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ea44d9c-ab58-51f5-869d-93ab6d414811 with identifier: ET01802 to the API
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:06:52Z',
 'fuel_type': 'diesel',
 'id': '2ea44d9c-ab58-51f5-869d-93ab6d414811',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET01802',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 268569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueEfficiency Edition Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Edition Avantgarde',
 'year': 2014}
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET01802%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Saving data for ET01802: {'auction_closing_time': 1774714012.0, 'created_time': 1774438317.454226, 'last_price_update_time': 1774643483.472764}
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET01802') HTTP/1.1" 204 0
2026-03-27 20:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: SD53912
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD53912%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Scrape type for SD53912: 2
2026-03-27 20:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0f12494-e882-5616-a62d-9ec9deda69ed with identifier: SD53912
2026-03-27 20:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0f12494-e882-5616-a62d-9ec9deda69ed with scrape type 2
2026-03-27 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0f12494-e882-5616-a62d-9ec9deda69ed with scrape type 2
2026-03-27 20:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e0f12494-e882-5616-a62d-9ec9deda69ed, identifier: SD53912
2026-03-27 20:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e0f12494-e882-5616-a62d-9ec9deda69ed with identifier: SD53912
2026-03-27 20:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e0f12494-e882-5616-a62d-9ec9deda69ed with identifier: SD53912
2026-03-27 20:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e0f12494-e882-5616-a62d-9ec9deda69ed with identifier: SD53912 to the API
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:52:39Z',
 'fuel_type': 'petrol',
 'id': 'e0f12494-e882-5616-a62d-9ec9deda69ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD53912',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 58757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-09',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2018}
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD53912%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Saving data for SD53912: {'auction_closing_time': 1774716759.0, 'created_time': 1773520241.224569, 'last_price_update_time': 1774643483.923438}
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD53912') HTTP/1.1" 204 0
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: YW10235
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW10235%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Scrape type for YW10235: 0
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: WP70532
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: MS53866
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS53866%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Scrape type for MS53866: 0
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-27 20:31:23 [auto1.be] INFO: Found listing with ID: JA16064
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA16064%27 HTTP/1.1" 200 None
2026-03-27 20:31:23 [auto1.be] INFO: Scrape type for JA16064: 2
2026-03-27 20:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fb68e3b-1a43-5f98-97fe-9dcf6fd88e12 with identifier: JA16064
2026-03-27 20:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fb68e3b-1a43-5f98-97fe-9dcf6fd88e12 with scrape type 2
2026-03-27 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fb68e3b-1a43-5f98-97fe-9dcf6fd88e12 with scrape type 2
2026-03-27 20:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7fb68e3b-1a43-5f98-97fe-9dcf6fd88e12, identifier: JA16064
2026-03-27 20:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7fb68e3b-1a43-5f98-97fe-9dcf6fd88e12 with identifier: JA16064
2026-03-27 20:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7fb68e3b-1a43-5f98-97fe-9dcf6fd88e12 with identifier: JA16064
2026-03-27 20:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7fb68e3b-1a43-5f98-97fe-9dcf6fd88e12 with identifier: JA16064 to the API
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:52:45Z',
 'fuel_type': 'hybrid',
 'id': '7fb68e3b-1a43-5f98-97fe-9dcf6fd88e12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA16064',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 141512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-20',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 HDi Hybrid4 Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2013}
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA16064%27 HTTP/1.1" 200 None
2026-03-27 20:31:24 [auto1.be] INFO: Saving data for JA16064: {'auction_closing_time': 1774716765.0, 'created_time': 1774002025.303311, 'last_price_update_time': 1774643484.36688}
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JA16064') HTTP/1.1" 204 0
2026-03-27 20:31:24 [auto1.be] INFO: Found listing with ID: WG15817
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG15817%27 HTTP/1.1" 200 None
2026-03-27 20:31:24 [auto1.be] INFO: Scrape type for WG15817: 0
2026-03-27 20:31:24 [auto1.be] INFO: Found listing with ID: JU85415
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU85415%27 HTTP/1.1" 200 None
2026-03-27 20:31:24 [auto1.be] INFO: Scrape type for JU85415: 0
2026-03-27 20:31:24 [auto1.be] INFO: Found listing with ID: BF20284
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF20284%27 HTTP/1.1" 200 None
2026-03-27 20:31:24 [auto1.be] INFO: Scrape type for BF20284: 0
2026-03-27 20:31:24 [auto1.be] INFO: Found listing with ID: BY76075
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY76075%27 HTTP/1.1" 200 None
2026-03-27 20:31:24 [auto1.be] INFO: Scrape type for BY76075: 0
2026-03-27 20:31:24 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-27 20:31:24 [auto1.be] INFO: Scrape type for MU18005: 0
2026-03-27 20:31:24 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE43146%27 HTTP/1.1" 200 None
2026-03-27 20:31:24 [auto1.be] INFO: Scrape type for UE43146: 0
2026-03-27 20:31:24 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-27 20:31:24 [auto1.be] INFO: Scrape type for NG50909: 2
2026-03-27 20:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909
2026-03-27 20:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 218f08b8-69a8-597a-92d9-597c477a7aa8 with scrape type 2
2026-03-27 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 218f08b8-69a8-597a-92d9-597c477a7aa8 with scrape type 2
2026-03-27 20:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 218f08b8-69a8-597a-92d9-597c477a7aa8, identifier: NG50909
2026-03-27 20:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909
2026-03-27 20:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909
2026-03-27 20:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909 to the API
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:50:53Z',
 'fuel_type': 'petrol',
 'id': '218f08b8-69a8-597a-92d9-597c477a7aa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG50909',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 146103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-20',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-27 20:31:25 [auto1.be] INFO: Saving data for NG50909: {'auction_closing_time': 1774716653.0, 'created_time': 1773137745.388471, 'last_price_update_time': 1774643485.085333}
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NG50909') HTTP/1.1" 204 0
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: JT25813
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT25813%27 HTTP/1.1" 200 None
2026-03-27 20:31:25 [auto1.be] INFO: Scrape type for JT25813: 0
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: TV14945
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV14945%27 HTTP/1.1" 200 None
2026-03-27 20:31:25 [auto1.be] INFO: Scrape type for TV14945: 0
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-27 20:31:25 [auto1.be] INFO: Scrape type for LE58292: 0
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-27 20:31:25 [auto1.be] INFO: Scrape type for WE56106: 0
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-27 20:31:25 [auto1.be] INFO: Scrape type for RW49064: 0
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: AH50870
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: TF91319
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-27 20:31:25 [auto1.be] INFO: Scrape type for ZP07177: 0
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-27 20:31:25 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-27 20:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK42644> (referer: https://www.auto1.com/v1/car-details-view/RK42644/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644
2026-03-27 20:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with scrape type 1
2026-03-27 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_e37ebe287a8bc67327dc91ee7530c816.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_e37ebe287a8bc67327dc91ee7530c816.jpg not downloaded yet
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_8783972b85bec53b991af6199054a87d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_8783972b85bec53b991af6199054a87d.jpg not downloaded yet
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_d66df1e021d94368633003819a40c331.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_d66df1e021d94368633003819a40c331.jpg not downloaded yet
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_ea0619cd4eb1a69c6436fe139abe7873.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_ea0619cd4eb1a69c6436fe139abe7873.jpg not downloaded yet
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_0041ea9879dbca10724be85aa75a15b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_0041ea9879dbca10724be85aa75a15b8.jpg not downloaded yet
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_039924679eb2a2465dd2a5a3c5902ef5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_039924679eb2a2465dd2a5a3c5902ef5.jpg not downloaded yet
2026-03-27 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_e37ebe287a8bc67327dc91ee7530c816.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_8783972b85bec53b991af6199054a87d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_9bc1ea8d4bbcdc480fa4a2bc5ac745ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_9bc1ea8d4bbcdc480fa4a2bc5ac745ff.jpg not downloaded yet
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_cc13df8ded36a21887b50c29463c4eb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_cc13df8ded36a21887b50c29463c4eb3.jpg not downloaded yet
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_a814cf5efd7e859d7dba72a376c96760.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_a814cf5efd7e859d7dba72a376c96760.jpg not downloaded yet
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_6ea99d120d7d0c225386d5321abea140.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_6ea99d120d7d0c225386d5321abea140.jpg not downloaded yet
2026-03-27 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_ea0619cd4eb1a69c6436fe139abe7873.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_0041ea9879dbca10724be85aa75a15b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bc1cd0>
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_e37ebe287a8bc67327dc91ee7530c816.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_e37ebe287a8bc67327dc91ee7530c816.jpg saved to cache
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435
2026-03-27 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_cc13df8ded36a21887b50c29463c4eb3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_039924679eb2a2465dd2a5a3c5902ef5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35344a390>
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_8783972b85bec53b991af6199054a87d.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_8783972b85bec53b991af6199054a87d.jpg saved to cache
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435
2026-03-27 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_9bc1ea8d4bbcdc480fa4a2bc5ac745ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_6ea99d120d7d0c225386d5321abea140.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_a814cf5efd7e859d7dba72a376c96760.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:26 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353481bd0>
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_ea0619cd4eb1a69c6436fe139abe7873.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_ea0619cd4eb1a69c6436fe139abe7873.jpg saved to cache
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435
2026-03-27 20:31:26 [auto1.be] INFO: Found listing with ID: KS30497
2026-03-27 20:31:26 [auto1.be] INFO: Found listing with ID: SA78346
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA78346%27 HTTP/1.1" 200 None
2026-03-27 20:31:26 [auto1.be] INFO: Scrape type for SA78346: 0
2026-03-27 20:31:26 [auto1.be] INFO: Found listing with ID: WJ28865
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ28865%27 HTTP/1.1" 200 None
2026-03-27 20:31:26 [auto1.be] INFO: Scrape type for WJ28865: 2
2026-03-27 20:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ab52355-6645-5450-a8e2-16952dbf9d32 with identifier: WJ28865
2026-03-27 20:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ab52355-6645-5450-a8e2-16952dbf9d32 with scrape type 2
2026-03-27 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ab52355-6645-5450-a8e2-16952dbf9d32 with scrape type 2
2026-03-27 20:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ab52355-6645-5450-a8e2-16952dbf9d32, identifier: WJ28865
2026-03-27 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_d66df1e021d94368633003819a40c331.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ab52355-6645-5450-a8e2-16952dbf9d32 with identifier: WJ28865
2026-03-27 20:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ab52355-6645-5450-a8e2-16952dbf9d32 with identifier: WJ28865
2026-03-27 20:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ab52355-6645-5450-a8e2-16952dbf9d32 with identifier: WJ28865 to the API
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:21:27Z',
 'fuel_type': 'diesel',
 'id': '3ab52355-6645-5450-a8e2-16952dbf9d32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ28865',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 155136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2015}
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ28865%27 HTTP/1.1" 200 None
2026-03-27 20:31:27 [auto1.be] INFO: Saving data for WJ28865: {'auction_closing_time': 1774714887.0, 'created_time': 1774438301.137847, 'last_price_update_time': 1774643487.468381}
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ28865') HTTP/1.1" 204 0
2026-03-27 20:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534b24d0>
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_0041ea9879dbca10724be85aa75a15b8.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_0041ea9879dbca10724be85aa75a15b8.jpg saved to cache
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: HB59251
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59251%27 HTTP/1.1" 200 None
2026-03-27 20:31:27 [auto1.be] INFO: Scrape type for HB59251: 0
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: GU08447
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: SE01545
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: YS62292
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS62292%27 HTTP/1.1" 200 None
2026-03-27 20:31:27 [auto1.be] INFO: Scrape type for YS62292: 1
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: JF05397
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-27 20:31:27 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: ZV64637
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: PZ19137
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ19137%27 HTTP/1.1" 200 None
2026-03-27 20:31:27 [auto1.be] INFO: Scrape type for PZ19137: 0
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: JS12412
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: YW35122
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: VP65458
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU16802%27 HTTP/1.1" 200 None
2026-03-27 20:31:27 [auto1.be] INFO: Scrape type for BU16802: 0
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: XK31036
2026-03-27 20:31:27 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-27 20:31:27 [auto1.be] INFO: Scrape type for CS98471: 1
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b22f10>
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_cc13df8ded36a21887b50c29463c4eb3.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_cc13df8ded36a21887b50c29463c4eb3.jpg saved to cache
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b2df90>
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_039924679eb2a2465dd2a5a3c5902ef5.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_039924679eb2a2465dd2a5a3c5902ef5.jpg saved to cache
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b18490>
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_9bc1ea8d4bbcdc480fa4a2bc5ac745ff.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_9bc1ea8d4bbcdc480fa4a2bc5ac745ff.jpg saved to cache
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534a59d0>
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_6ea99d120d7d0c225386d5321abea140.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_6ea99d120d7d0c225386d5321abea140.jpg saved to cache
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534a5450>
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_a814cf5efd7e859d7dba72a376c96760.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_a814cf5efd7e859d7dba72a376c96760.jpg saved to cache
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435
2026-03-27 20:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35348cdd0>
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa4%252F9da4343405abc48c963f997ae313b4a2%252Fpa%252FRK42644_d66df1e021d94368633003819a40c331.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_d66df1e021d94368633003819a40c331.jpg saved to cache
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435
2026-03-27 20:31:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435, skipping ID generation
2026-03-27 20:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with scrape type 1
2026-03-27 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 sending to next pipeline
2026-03-27 20:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435, identifier: RK42644
2026-03-27 20:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644
2026-03-27 20:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644
2026-03-27 20:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644 to the API
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_d66df1e021d94368633003819a40c331.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:52:01Z',
 'fuel_type': 'diesel',
 'id': '3ccf5a2e-b5a8-5937-8bc2-d593eb497435',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK42644',
 'listing': 'auction',
 'location': 'BE, Grimbergen',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 168399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_e37ebe287a8bc67327dc91ee7530c816.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_8783972b85bec53b991af6199054a87d.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_d66df1e021d94368633003819a40c331.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_ea0619cd4eb1a69c6436fe139abe7873.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_0041ea9879dbca10724be85aa75a15b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_039924679eb2a2465dd2a5a3c5902ef5.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_9bc1ea8d4bbcdc480fa4a2bc5ac745ff.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_cc13df8ded36a21887b50c29463c4eb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_a814cf5efd7e859d7dba72a376c96760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccf5a2e-b5a8-5937-8bc2-d593eb497435/3ccf5a2e-b5a8-5937-8bc2-d593eb497435_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/a4/9da4343405abc48c963f997ae313b4a2/pa/RK42644_6ea99d120d7d0c225386d5321abea140.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2011}
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Saving data for RK42644: {'created_time': 1774643488.360626, 'last_price_update_time': 1774643488.360636, 'auction_closing_time': 1774716721.0}
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK42644') HTTP/1.1" 204 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for RB53949: 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: LB84163
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB84163%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for LB84163: 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: XG51748
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG51748%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for XG51748: 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: UM09750
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: WP96232
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP96232%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for WP96232: 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: XP29569
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP29569%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for XP29569: 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: KM78271
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for HS59761: 1
2026-03-27 20:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD69002%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for SD69002: 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for RK05604: 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for XZ27909: 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: ET07668
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for CS90165: 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: WE24792
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: SP41494
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: YA31821
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for XC10139: 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for GA09150: 0
2026-03-27 20:31:28 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-27 20:31:28 [auto1.be] INFO: Scrape type for DF44974: 0
2026-03-27 20:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS98471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS59761/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:29 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:29 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-27 20:31:29 [auto1.be] INFO: Found listing with ID: SD62634
2026-03-27 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD62634%27 HTTP/1.1" 200 None
2026-03-27 20:31:29 [auto1.be] INFO: Scrape type for SD62634: 0
2026-03-27 20:31:29 [auto1.be] INFO: Found listing with ID: FP33108
2026-03-27 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP33108%27 HTTP/1.1" 200 None
2026-03-27 20:31:29 [auto1.be] INFO: Scrape type for FP33108: 0
2026-03-27 20:31:29 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-27 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-27 20:31:29 [auto1.be] INFO: Scrape type for GS48835: 0
2026-03-27 20:31:29 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-27 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-27 20:31:29 [auto1.be] INFO: Scrape type for JM27578: 0
2026-03-27 20:31:29 [auto1.be] INFO: Found listing with ID: MS83423
2026-03-27 20:31:29 [auto1.be] INFO: Found listing with ID: RM99520
2026-03-27 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM99520%27 HTTP/1.1" 200 None
2026-03-27 20:31:29 [auto1.be] INFO: Scrape type for RM99520: 2
2026-03-27 20:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f330255-9d38-5cff-9d67-58eb7b4d8f05 with identifier: RM99520
2026-03-27 20:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f330255-9d38-5cff-9d67-58eb7b4d8f05 with scrape type 2
2026-03-27 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f330255-9d38-5cff-9d67-58eb7b4d8f05 with scrape type 2
2026-03-27 20:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f330255-9d38-5cff-9d67-58eb7b4d8f05, identifier: RM99520
2026-03-27 20:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f330255-9d38-5cff-9d67-58eb7b4d8f05 with identifier: RM99520
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-27 20:31:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f330255-9d38-5cff-9d67-58eb7b4d8f05 with identifier: RM99520
2026-03-27 20:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f330255-9d38-5cff-9d67-58eb7b4d8f05 with identifier: RM99520 to the API
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:29:49Z',
 'fuel_type': 'diesel',
 'id': '2f330255-9d38-5cff-9d67-58eb7b4d8f05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM99520',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 315548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-21',
 'seller_name': None,
 'title': 'Fiat Talento 1.6 TwinTurbo Diesel Ecojet L2H1 DoKa 1,2t SX',
 'transmission': 'manual',
 'trim': 'L2H1 DoKa 1,2t SX',
 'year': 2018}
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM99520%27 HTTP/1.1" 200 None
2026-03-27 20:31:30 [auto1.be] INFO: Saving data for RM99520: {'auction_closing_time': 1774715389.0, 'created_time': 1773136957.295651, 'last_price_update_time': 1774643490.452918}
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RM99520') HTTP/1.1" 204 0
2026-03-27 20:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: CY81530
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY81530%27 HTTP/1.1" 200 None
2026-03-27 20:31:30 [auto1.be] INFO: Scrape type for CY81530: 0
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: RJ35563
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-27 20:31:30 [auto1.be] INFO: Scrape type for HP15544: 0
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-27 20:31:30 [auto1.be] INFO: Scrape type for TX85632: 0
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: VY02593
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY02593%27 HTTP/1.1" 200 None
2026-03-27 20:31:30 [auto1.be] INFO: Scrape type for VY02593: 0
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: HK96372
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK96372%27 HTTP/1.1" 200 None
2026-03-27 20:31:30 [auto1.be] INFO: Scrape type for HK96372: 0
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: KW54495
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-27 20:31:30 [auto1.be] INFO: Scrape type for LW74134: 0
2026-03-27 20:31:30 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-27 20:31:30 [auto1.be] INFO: Scrape type for AK54797: 2
2026-03-27 20:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797
2026-03-27 20:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4862eee9-488b-5df7-afbe-2532b1169169 with scrape type 2
2026-03-27 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4862eee9-488b-5df7-afbe-2532b1169169 with scrape type 2
2026-03-27 20:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4862eee9-488b-5df7-afbe-2532b1169169, identifier: AK54797
2026-03-27 20:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797
2026-03-27 20:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797
2026-03-27 20:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797 to the API
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:48:52Z',
 'fuel_type': 'diesel',
 'id': '4862eee9-488b-5df7-afbe-2532b1169169',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK54797',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 113656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-15',
 'seller_name': None,
 'title': 'Land Rover Evoque D165 Mild-Hybrid R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2021}
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-27 20:31:31 [auto1.be] INFO: Saving data for AK54797: {'auction_closing_time': 1774716532.0, 'created_time': 1774557066.316145, 'last_price_update_time': 1774643491.033235}
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AK54797') HTTP/1.1" 204 0
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: SN36947
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN36947%27 HTTP/1.1" 200 None
2026-03-27 20:31:31 [auto1.be] INFO: Scrape type for SN36947: 0
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW33850%27 HTTP/1.1" 200 None
2026-03-27 20:31:31 [auto1.be] INFO: Scrape type for WW33850: 0
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: EW19960
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-27 20:31:31 [auto1.be] INFO: Scrape type for YS48127: 2
2026-03-27 20:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127
2026-03-27 20:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ee751d-f055-5e28-95a6-64d8df2ac6be with scrape type 2
2026-03-27 20:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6ee751d-f055-5e28-95a6-64d8df2ac6be with scrape type 2
2026-03-27 20:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6ee751d-f055-5e28-95a6-64d8df2ac6be, identifier: YS48127
2026-03-27 20:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127
2026-03-27 20:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127
2026-03-27 20:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127 to the API
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:04:53Z',
 'fuel_type': 'petrol',
 'id': 'f6ee751d-f055-5e28-95a6-64d8df2ac6be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS48127',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 117688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-27 20:31:31 [auto1.be] INFO: Saving data for YS48127: {'auction_closing_time': 1774713893.0, 'created_time': 1774557038.688555, 'last_price_update_time': 1774643491.776707}
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS48127') HTTP/1.1" 204 0
2026-03-27 20:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS98471> (referer: https://www.auto1.com/v1/car-details-view/CS98471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: VL30706
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: DT44813
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-27 20:31:31 [auto1.be] INFO: Scrape type for RW15578: 0
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA83535%27 HTTP/1.1" 200 None
2026-03-27 20:31:31 [auto1.be] INFO: Scrape type for NA83535: 0
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: GS77634
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: NH29158
2026-03-27 20:31:31 [auto1.be] INFO: Found listing with ID: MR56300
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR56300%27 HTTP/1.1" 200 None
2026-03-27 20:31:31 [auto1.be] INFO: Scrape type for MR56300: 2
2026-03-27 20:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfc6a77e-15e9-570b-a2dc-fbf5cf76e47e with identifier: MR56300
2026-03-27 20:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfc6a77e-15e9-570b-a2dc-fbf5cf76e47e with scrape type 2
2026-03-27 20:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfc6a77e-15e9-570b-a2dc-fbf5cf76e47e with scrape type 2
2026-03-27 20:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dfc6a77e-15e9-570b-a2dc-fbf5cf76e47e, identifier: MR56300
2026-03-27 20:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dfc6a77e-15e9-570b-a2dc-fbf5cf76e47e with identifier: MR56300
2026-03-27 20:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dfc6a77e-15e9-570b-a2dc-fbf5cf76e47e with identifier: MR56300
2026-03-27 20:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dfc6a77e-15e9-570b-a2dc-fbf5cf76e47e with identifier: MR56300 to the API
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:50:53Z',
 'fuel_type': 'petrol',
 'id': 'dfc6a77e-15e9-570b-a2dc-fbf5cf76e47e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR56300',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 72341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2006}
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR56300%27 HTTP/1.1" 200 None
2026-03-27 20:31:32 [auto1.be] INFO: Saving data for MR56300: {'auction_closing_time': 1774716653.0, 'created_time': 1774438233.133081, 'last_price_update_time': 1774643492.219524}
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MR56300') HTTP/1.1" 204 0
2026-03-27 20:31:32 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-27 20:31:32 [auto1.be] INFO: Scrape type for BN63741: 2
2026-03-27 20:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741
2026-03-27 20:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with scrape type 2
2026-03-27 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with scrape type 2
2026-03-27 20:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e36d345a-bd0c-58ee-b38f-cae5980cf0a6, identifier: BN63741
2026-03-27 20:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741
2026-03-27 20:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741
2026-03-27 20:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741 to the API
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:53:46Z',
 'fuel_type': 'petrol',
 'id': 'e36d345a-bd0c-58ee-b38f-cae5980cf0a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN63741',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 13380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-07',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2024}
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-27 20:31:32 [auto1.be] INFO: Saving data for BN63741: {'auction_closing_time': 1774716826.0, 'created_time': 1774557027.861188, 'last_price_update_time': 1774643492.657852}
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BN63741') HTTP/1.1" 204 0
2026-03-27 20:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471
2026-03-27 20:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with scrape type 1
2026-03-27 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_a842ef54043c34a8432ea053d4959188.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_a842ef54043c34a8432ea053d4959188.jpg not downloaded yet
2026-03-27 20:31:32 [auto1.be] INFO: Found listing with ID: DY53822
2026-03-27 20:31:32 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-27 20:31:32 [auto1.be] INFO: Scrape type for ZC67013: 2
2026-03-27 20:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013
2026-03-27 20:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with scrape type 2
2026-03-27 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with scrape type 2
2026-03-27 20:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4, identifier: ZC67013
2026-03-27 20:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013
2026-03-27 20:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013
2026-03-27 20:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013 to the API
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:13Z',
 'fuel_type': 'diesel',
 'id': '5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC67013',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 233200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-18',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [auto1.be] INFO: Saving data for ZC67013: {'auction_closing_time': 1774713853.0, 'created_time': 1774254677.819703, 'last_price_update_time': 1774643493.053968}
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC67013') HTTP/1.1" 204 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_9cd7d43ae770a90b2773682806e1b311.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_9cd7d43ae770a90b2773682806e1b311.jpg not downloaded yet
2026-03-27 20:31:33 [auto1.be] INFO: Found listing with ID: TX50004
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50004%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [auto1.be] INFO: Scrape type for TX50004: 0
2026-03-27 20:31:33 [auto1.be] INFO: Found listing with ID: FK81343
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK81343%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [auto1.be] INFO: Scrape type for FK81343: 1
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_ccdee1de24bbc628b92d2e79a358724d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_ccdee1de24bbc628b92d2e79a358724d.jpg not downloaded yet
2026-03-27 20:31:33 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-27 20:31:33 [auto1.be] INFO: Found listing with ID: RA35148
2026-03-27 20:31:33 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [auto1.be] INFO: Scrape type for WC10504: 0
2026-03-27 20:31:33 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS59761> (referer: https://www.auto1.com/v1/car-details-view/HS59761/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_fca0f3674395b7b15decfdd5f436f394.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_fca0f3674395b7b15decfdd5f436f394.jpg not downloaded yet
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_a00ce362c060b36f2044102ab69a17c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_a00ce362c060b36f2044102ab69a17c5.jpg not downloaded yet
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_53c29dbed189f0f32cee897f5168ad18.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_53c29dbed189f0f32cee897f5168ad18.jpg not downloaded yet
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_a842ef54043c34a8432ea053d4959188.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_2e48404d6ad87b72eec40d34afb8ed16.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_2e48404d6ad87b72eec40d34afb8ed16.jpg not downloaded yet
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_59b0930510e2165c624964f1881fdd3e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_59b0930510e2165c624964f1881fdd3e.jpg not downloaded yet
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_88028a3f53fa85963ed3a1f89f90040a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_88028a3f53fa85963ed3a1f89f90040a.jpg not downloaded yet
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_b2c16dd4a9e019549780d9f9adcf9f38.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_b2c16dd4a9e019549780d9f9adcf9f38.jpg not downloaded yet
2026-03-27 20:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761
2026-03-27 20:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with scrape type 1
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_0daa31e2d06003cdb0c8abdeda694b4e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_0daa31e2d06003cdb0c8abdeda694b4e.jpg not downloaded yet
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_ccdee1de24bbc628b92d2e79a358724d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_9cd7d43ae770a90b2773682806e1b311.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_545fb8d6bc7fa0289948da81ac04ac86.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_545fb8d6bc7fa0289948da81ac04ac86.jpg not downloaded yet
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35346bed0>
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_a842ef54043c34a8432ea053d4959188.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_a842ef54043c34a8432ea053d4959188.jpg saved to cache
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_fca0f3674395b7b15decfdd5f436f394.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_9b4d37a98517956cf0a9daf6db190110.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_9b4d37a98517956cf0a9daf6db190110.jpg not downloaded yet
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_59b0930510e2165c624964f1881fdd3e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_a00ce362c060b36f2044102ab69a17c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_5712bf9ed0a0c3d457d6f742512c28c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_5712bf9ed0a0c3d457d6f742512c28c7.jpg not downloaded yet
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_2e48404d6ad87b72eec40d34afb8ed16.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_b2c16dd4a9e019549780d9f9adcf9f38.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_e08bb0c5beb87ec94cddc451ce86919b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_e08bb0c5beb87ec94cddc451ce86919b.jpg not downloaded yet
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_0daa31e2d06003cdb0c8abdeda694b4e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353599c10>
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_ccdee1de24bbc628b92d2e79a358724d.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_ccdee1de24bbc628b92d2e79a358724d.jpg saved to cache
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35355d710>
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_9cd7d43ae770a90b2773682806e1b311.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_9cd7d43ae770a90b2773682806e1b311.jpg saved to cache
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_53c29dbed189f0f32cee897f5168ad18.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_c31bcf6057677e05b4e19f32e5a4a5a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_c31bcf6057677e05b4e19f32e5a4a5a8.jpg not downloaded yet
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_545fb8d6bc7fa0289948da81ac04ac86.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_9b4d37a98517956cf0a9daf6db190110.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_4a246aacb1d5636761122fcc68e03bb7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_4a246aacb1d5636761122fcc68e03bb7.jpg not downloaded yet
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353432b10>
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_fca0f3674395b7b15decfdd5f436f394.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_fca0f3674395b7b15decfdd5f436f394.jpg saved to cache
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353549890>
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_59b0930510e2165c624964f1881fdd3e.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_59b0930510e2165c624964f1881fdd3e.jpg saved to cache
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b64d90>
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_a00ce362c060b36f2044102ab69a17c5.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_a00ce362c060b36f2044102ab69a17c5.jpg saved to cache
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a11f50>
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_2e48404d6ad87b72eec40d34afb8ed16.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_2e48404d6ad87b72eec40d34afb8ed16.jpg saved to cache
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b673d0>
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_b2c16dd4a9e019549780d9f9adcf9f38.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_b2c16dd4a9e019549780d9f9adcf9f38.jpg saved to cache
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_84918f36ca996bb1bb4df088de1b35ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_84918f36ca996bb1bb4df088de1b35ac.jpg not downloaded yet
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536acad0>
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_0daa31e2d06003cdb0c8abdeda694b4e.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_0daa31e2d06003cdb0c8abdeda694b4e.jpg saved to cache
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_5712bf9ed0a0c3d457d6f742512c28c7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_e08bb0c5beb87ec94cddc451ce86919b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_3ee7ff353e1307f9a5e2ead586830cce.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_3ee7ff353e1307f9a5e2ead586830cce.jpg not downloaded yet
2026-03-27 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b3ab50>
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_53c29dbed189f0f32cee897f5168ad18.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_53c29dbed189f0f32cee897f5168ad18.jpg saved to cache
2026-03-27 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3535495d0>
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_545fb8d6bc7fa0289948da81ac04ac86.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_545fb8d6bc7fa0289948da81ac04ac86.jpg saved to cache
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353446d90>
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_9b4d37a98517956cf0a9daf6db190110.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_9b4d37a98517956cf0a9daf6db190110.jpg saved to cache
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_72b0df43a074aecc86be060decbd5dae.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_72b0df43a074aecc86be060decbd5dae.jpg not downloaded yet
2026-03-27 20:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_4a246aacb1d5636761122fcc68e03bb7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a11350>
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_5712bf9ed0a0c3d457d6f742512c28c7.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_5712bf9ed0a0c3d457d6f742512c28c7.jpg saved to cache
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353545110>
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_e08bb0c5beb87ec94cddc451ce86919b.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_e08bb0c5beb87ec94cddc451ce86919b.jpg saved to cache
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f
2026-03-27 20:31:34 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1659 | hits on page: 40
2026-03-27 20:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_88028a3f53fa85963ed3a1f89f90040a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:34 [auto1.be] INFO: Found listing with ID: VF97683
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF97683%27 HTTP/1.1" 200 None
2026-03-27 20:31:34 [auto1.be] INFO: Scrape type for VF97683: 0
2026-03-27 20:31:34 [auto1.be] INFO: Found listing with ID: FL89669
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL89669%27 HTTP/1.1" 200 None
2026-03-27 20:31:34 [auto1.be] INFO: Scrape type for FL89669: 1
2026-03-27 20:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_84918f36ca996bb1bb4df088de1b35ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_3ee7ff353e1307f9a5e2ead586830cce.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:34 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ67143%27 HTTP/1.1" 200 None
2026-03-27 20:31:34 [auto1.be] INFO: Scrape type for RZ67143: 2
2026-03-27 20:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3845ba47-1b81-5137-99c9-0db27fcae5e1 with identifier: RZ67143
2026-03-27 20:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3845ba47-1b81-5137-99c9-0db27fcae5e1 with scrape type 2
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3845ba47-1b81-5137-99c9-0db27fcae5e1 with scrape type 2
2026-03-27 20:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3845ba47-1b81-5137-99c9-0db27fcae5e1, identifier: RZ67143
2026-03-27 20:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3845ba47-1b81-5137-99c9-0db27fcae5e1 with identifier: RZ67143
2026-03-27 20:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3845ba47-1b81-5137-99c9-0db27fcae5e1 with identifier: RZ67143
2026-03-27 20:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3845ba47-1b81-5137-99c9-0db27fcae5e1 with identifier: RZ67143 to the API
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:42:53Z',
 'fuel_type': 'petrol',
 'id': '3845ba47-1b81-5137-99c9-0db27fcae5e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ67143',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 70584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ67143%27 HTTP/1.1" 200 None
2026-03-27 20:31:34 [auto1.be] INFO: Saving data for RZ67143: {'auction_closing_time': 1774716173.0, 'created_time': 1773301661.376532, 'last_price_update_time': 1774643494.6636}
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RZ67143') HTTP/1.1" 204 0
2026-03-27 20:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35340d490>
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_4a246aacb1d5636761122fcc68e03bb7.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_4a246aacb1d5636761122fcc68e03bb7.jpg saved to cache
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f
2026-03-27 20:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_c31bcf6057677e05b4e19f32e5a4a5a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_72b0df43a074aecc86be060decbd5dae.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:34 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-27 20:31:34 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ68089%27 HTTP/1.1" 200 None
2026-03-27 20:31:34 [auto1.be] INFO: Scrape type for HJ68089: 0
2026-03-27 20:31:34 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-27 20:31:34 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-27 20:31:34 [auto1.be] INFO: Scrape type for ZH14429: 2
2026-03-27 20:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429
2026-03-27 20:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc7588cc-1942-54d2-b932-522eaa422537 with scrape type 2
2026-03-27 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc7588cc-1942-54d2-b932-522eaa422537 with scrape type 2
2026-03-27 20:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc7588cc-1942-54d2-b932-522eaa422537, identifier: ZH14429
2026-03-27 20:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429
2026-03-27 20:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429
2026-03-27 20:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429 to the API
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:21:12Z',
 'fuel_type': 'diesel',
 'id': 'fc7588cc-1942-54d2-b932-522eaa422537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH14429',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 233552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-19',
 'seller_name': None,
 'title': 'Kia Rio 1.1 CRDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-27 20:31:35 [auto1.be] INFO: Saving data for ZH14429: {'auction_closing_time': 1774714872.0, 'created_time': 1774557037.957116, 'last_price_update_time': 1774643495.192964}
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH14429') HTTP/1.1" 204 0
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534869d0>
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F73%252F7d732a1c41136d7216e390aa0dcfcbb4%252Fpa%252FCS98471_88028a3f53fa85963ed3a1f89f90040a.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_88028a3f53fa85963ed3a1f89f90040a.jpg saved to cache
2026-03-27 20:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025
2026-03-27 20:31:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025, skipping ID generation
2026-03-27 20:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with scrape type 1
2026-03-27 20:31:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 sending to next pipeline
2026-03-27 20:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025, identifier: CS98471
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35358e510>
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_84918f36ca996bb1bb4df088de1b35ac.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_84918f36ca996bb1bb4df088de1b35ac.jpg saved to cache
2026-03-27 20:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b58490>
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_3ee7ff353e1307f9a5e2ead586830cce.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_3ee7ff353e1307f9a5e2ead586830cce.jpg saved to cache
2026-03-27 20:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f
2026-03-27 20:31:35 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-27 20:31:35 [auto1.be] INFO: Scrape type for RF80171: 0
2026-03-27 20:31:35 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-27 20:31:35 [auto1.be] INFO: Found listing with ID: EB43323
2026-03-27 20:31:35 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-27 20:31:35 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS70949%27 HTTP/1.1" 200 None
2026-03-27 20:31:35 [auto1.be] INFO: Scrape type for MS70949: 0
2026-03-27 20:31:35 [auto1.be] INFO: Found listing with ID: US70780
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US70780%27 HTTP/1.1" 200 None
2026-03-27 20:31:35 [auto1.be] INFO: Scrape type for US70780: 0
2026-03-27 20:31:35 [auto1.be] INFO: Found listing with ID: LE21271
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE21271%27 HTTP/1.1" 200 None
2026-03-27 20:31:35 [auto1.be] INFO: Scrape type for LE21271: 2
2026-03-27 20:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf7f8c6b-9ba7-52bf-ac65-b576b6faf047 with identifier: LE21271
2026-03-27 20:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf7f8c6b-9ba7-52bf-ac65-b576b6faf047 with scrape type 2
2026-03-27 20:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf7f8c6b-9ba7-52bf-ac65-b576b6faf047 with scrape type 2
2026-03-27 20:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf7f8c6b-9ba7-52bf-ac65-b576b6faf047, identifier: LE21271
2026-03-27 20:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471
2026-03-27 20:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471
2026-03-27 20:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471 to the API
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_88028a3f53fa85963ed3a1f89f90040a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 159,
 'expiration_date': '2026-03-28T16:15:46Z',
 'fuel_type': 'petrol',
 'id': '485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS98471',
 'listing': 'auction',
 'location': 'BE, Mechelen',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 126726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 28,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_a842ef54043c34a8432ea053d4959188.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_9cd7d43ae770a90b2773682806e1b311.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_ccdee1de24bbc628b92d2e79a358724d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_fca0f3674395b7b15decfdd5f436f394.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_a00ce362c060b36f2044102ab69a17c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_53c29dbed189f0f32cee897f5168ad18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_2e48404d6ad87b72eec40d34afb8ed16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_59b0930510e2165c624964f1881fdd3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_88028a3f53fa85963ed3a1f89f90040a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025/485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/73/7d732a1c41136d7216e390aa0dcfcbb4/pa/CS98471_b2c16dd4a9e019549780d9f9adcf9f38.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.3 DIG-T Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2019}
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-27 20:31:35 [auto1.be] INFO: Saving data for CS98471: {'created_time': 1774643495.833765, 'last_price_update_time': 1774643495.833773, 'auction_closing_time': 1774714546.0}
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS98471') HTTP/1.1" 204 0
2026-03-27 20:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf7f8c6b-9ba7-52bf-ac65-b576b6faf047 with identifier: LE21271
2026-03-27 20:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf7f8c6b-9ba7-52bf-ac65-b576b6faf047 with identifier: LE21271
2026-03-27 20:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf7f8c6b-9ba7-52bf-ac65-b576b6faf047 with identifier: LE21271 to the API
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:38:30Z',
 'fuel_type': 'petrol',
 'id': 'bf7f8c6b-9ba7-52bf-ac65-b576b6faf047',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE21271',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 141932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 TGDI Creative 2WD',
 'transmission': 'automatic',
 'trim': 'Creative 2WD',
 'year': 2019}
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE21271%27 HTTP/1.1" 200 None
2026-03-27 20:31:36 [auto1.be] INFO: Saving data for LE21271: {'auction_closing_time': 1774715910.0, 'created_time': 1774438296.099871, 'last_price_update_time': 1774643496.18342}
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE21271') HTTP/1.1" 204 0
2026-03-27 20:31:36 [auto1.be] INFO: Found listing with ID: LL17745
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL17745%27 HTTP/1.1" 200 None
2026-03-27 20:31:36 [auto1.be] INFO: Scrape type for LL17745: 0
2026-03-27 20:31:36 [auto1.be] INFO: Found listing with ID: JH06099
2026-03-27 20:31:36 [auto1.be] INFO: Found listing with ID: WJ27954
2026-03-27 20:31:36 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-27 20:31:36 [auto1.be] INFO: Scrape type for GG92230: 2
2026-03-27 20:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230
2026-03-27 20:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d05296d-0859-511e-9c11-3277a7c46677 with scrape type 2
2026-03-27 20:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d05296d-0859-511e-9c11-3277a7c46677 with scrape type 2
2026-03-27 20:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7d05296d-0859-511e-9c11-3277a7c46677, identifier: GG92230
2026-03-27 20:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536784d0>
2026-03-27 20:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_c31bcf6057677e05b4e19f32e5a4a5a8.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_c31bcf6057677e05b4e19f32e5a4a5a8.jpg saved to cache
2026-03-27 20:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f
2026-03-27 20:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf6ed0>
2026-03-27 20:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F55%252Fb455c6fb8675614380ce8ddb1447d4a0%252Fpa%252FHS59761_72b0df43a074aecc86be060decbd5dae.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_72b0df43a074aecc86be060decbd5dae.jpg saved to cache
2026-03-27 20:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f
2026-03-27 20:31:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f, skipping ID generation
2026-03-27 20:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with scrape type 1
2026-03-27 20:31:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f sending to next pipeline
2026-03-27 20:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f, identifier: HS59761
2026-03-27 20:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230
2026-03-27 20:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230
2026-03-27 20:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230 to the API
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:09Z',
 'fuel_type': 'diesel',
 'id': '7d05296d-0859-511e-9c11-3277a7c46677',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG92230',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 98622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-27 20:31:36 [auto1.be] INFO: Saving data for GG92230: {'auction_closing_time': 1774715349.0, 'created_time': 1773953006.288354, 'last_price_update_time': 1774643496.789985}
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GG92230') HTTP/1.1" 204 0
2026-03-27 20:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761
2026-03-27 20:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761
2026-03-27 20:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761 to the API
2026-03-27 20:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_72b0df43a074aecc86be060decbd5dae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:58:14Z',
 'fuel_type': 'diesel',
 'id': '3fd75480-87a9-57c0-b2a5-e785c4c31e4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS59761',
 'listing': 'auction',
 'location': 'BE, Mechelen',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 72994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_0daa31e2d06003cdb0c8abdeda694b4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_545fb8d6bc7fa0289948da81ac04ac86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_9b4d37a98517956cf0a9daf6db190110.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_5712bf9ed0a0c3d457d6f742512c28c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_e08bb0c5beb87ec94cddc451ce86919b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_c31bcf6057677e05b4e19f32e5a4a5a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_4a246aacb1d5636761122fcc68e03bb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_84918f36ca996bb1bb4df088de1b35ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_3ee7ff353e1307f9a5e2ead586830cce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd75480-87a9-57c0-b2a5-e785c4c31e4f/3fd75480-87a9-57c0-b2a5-e785c4c31e4f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/55/b455c6fb8675614380ce8ddb1447d4a0/pa/HS59761_72b0df43a074aecc86be060decbd5dae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Pack',
 'transmission': 'automatic',
 'trim': 'Active Pack',
 'year': 2023}
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-27 20:31:37 [auto1.be] INFO: Saving data for HS59761: {'created_time': 1774643497.148986, 'last_price_update_time': 1774643497.149002, 'auction_closing_time': 1774717094.0}
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS59761') HTTP/1.1" 204 0
2026-03-27 20:31:37 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM55843%27 HTTP/1.1" 200 None
2026-03-27 20:31:37 [auto1.be] INFO: Scrape type for CM55843: 0
2026-03-27 20:31:37 [auto1.be] INFO: Found listing with ID: AA14466
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA14466%27 HTTP/1.1" 200 None
2026-03-27 20:31:37 [auto1.be] INFO: Scrape type for AA14466: 2
2026-03-27 20:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce8f2b46-54be-58ec-ba63-2234ba4aec2f with identifier: AA14466
2026-03-27 20:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce8f2b46-54be-58ec-ba63-2234ba4aec2f with scrape type 2
2026-03-27 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce8f2b46-54be-58ec-ba63-2234ba4aec2f with scrape type 2
2026-03-27 20:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ce8f2b46-54be-58ec-ba63-2234ba4aec2f, identifier: AA14466
2026-03-27 20:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ce8f2b46-54be-58ec-ba63-2234ba4aec2f with identifier: AA14466
2026-03-27 20:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ce8f2b46-54be-58ec-ba63-2234ba4aec2f with identifier: AA14466
2026-03-27 20:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ce8f2b46-54be-58ec-ba63-2234ba4aec2f with identifier: AA14466 to the API
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:54:10Z',
 'fuel_type': 'diesel',
 'id': 'ce8f2b46-54be-58ec-ba63-2234ba4aec2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA14466',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 330264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-05',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA14466%27 HTTP/1.1" 200 None
2026-03-27 20:31:37 [auto1.be] INFO: Saving data for AA14466: {'auction_closing_time': 1774716850.0, 'created_time': 1774438251.521307, 'last_price_update_time': 1774643497.533381}
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AA14466') HTTP/1.1" 204 0
2026-03-27 20:31:37 [auto1.be] INFO: Found listing with ID: JS61863
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS61863%27 HTTP/1.1" 200 None
2026-03-27 20:31:37 [auto1.be] INFO: Scrape type for JS61863: 0
2026-03-27 20:31:37 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-27 20:31:37 [auto1.be] INFO: Found listing with ID: TR58381
2026-03-27 20:31:37 [auto1.be] INFO: Found listing with ID: WM08929
2026-03-27 20:31:37 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-27 20:31:37 [auto1.be] INFO: Found listing with ID: HJ85146
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ85146%27 HTTP/1.1" 200 None
2026-03-27 20:31:37 [auto1.be] INFO: Scrape type for HJ85146: 2
2026-03-27 20:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fee7906f-f3b7-5ccd-b58d-bb0f115c8d17 with identifier: HJ85146
2026-03-27 20:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fee7906f-f3b7-5ccd-b58d-bb0f115c8d17 with scrape type 2
2026-03-27 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fee7906f-f3b7-5ccd-b58d-bb0f115c8d17 with scrape type 2
2026-03-27 20:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fee7906f-f3b7-5ccd-b58d-bb0f115c8d17, identifier: HJ85146
2026-03-27 20:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fee7906f-f3b7-5ccd-b58d-bb0f115c8d17 with identifier: HJ85146
2026-03-27 20:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fee7906f-f3b7-5ccd-b58d-bb0f115c8d17 with identifier: HJ85146
2026-03-27 20:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fee7906f-f3b7-5ccd-b58d-bb0f115c8d17 with identifier: HJ85146 to the API
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:33:56Z',
 'fuel_type': 'diesel',
 'id': 'fee7906f-f3b7-5ccd-b58d-bb0f115c8d17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ85146',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 269117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-05',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ85146%27 HTTP/1.1" 200 None
2026-03-27 20:31:37 [auto1.be] INFO: Saving data for HJ85146: {'auction_closing_time': 1774715636.0, 'created_time': 1774438229.29951, 'last_price_update_time': 1774643497.937811}
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ85146') HTTP/1.1" 204 0
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: HS04385
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-27 20:31:38 [auto1.be] INFO: Scrape type for RH88749: 2
2026-03-27 20:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749
2026-03-27 20:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with scrape type 2
2026-03-27 20:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with scrape type 2
2026-03-27 20:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd, identifier: RH88749
2026-03-27 20:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749
2026-03-27 20:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749
2026-03-27 20:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749 to the API
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-28T16:52:08Z',
 'fuel_type': 'diesel',
 'id': '1c8d90b4-4d1c-5e19-b032-06761a4fd7fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH88749',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 273273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-29',
 'seller_name': None,
 'title': 'Citroen C1 1.4 HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2006}
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-27 20:31:38 [auto1.be] INFO: Saving data for RH88749: {'auction_closing_time': 1774716728.0, 'created_time': 1774557093.65814, 'last_price_update_time': 1774643498.571856}
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RH88749') HTTP/1.1" 204 0
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: YN50786
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: CM09652
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: CB51818
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB51818%27 HTTP/1.1" 200 None
2026-03-27 20:31:38 [auto1.be] INFO: Scrape type for CB51818: 1
2026-03-27 20:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS62292/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: CH75684
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH75684%27 HTTP/1.1" 200 None
2026-03-27 20:31:38 [auto1.be] INFO: Scrape type for CH75684: 0
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-27 20:31:38 [auto1.be] INFO: Scrape type for XR84470: 0
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: TL97420
2026-03-27 20:31:38 [auto1.be] INFO: Found listing with ID: WP12382
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP12382%27 HTTP/1.1" 200 None
2026-03-27 20:31:38 [auto1.be] INFO: Scrape type for WP12382: 2
2026-03-27 20:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0168d43f-cbb3-5941-8422-07e258da95af with identifier: WP12382
2026-03-27 20:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0168d43f-cbb3-5941-8422-07e258da95af with scrape type 2
2026-03-27 20:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0168d43f-cbb3-5941-8422-07e258da95af with scrape type 2
2026-03-27 20:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0168d43f-cbb3-5941-8422-07e258da95af, identifier: WP12382
2026-03-27 20:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL89669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0168d43f-cbb3-5941-8422-07e258da95af with identifier: WP12382
2026-03-27 20:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0168d43f-cbb3-5941-8422-07e258da95af with identifier: WP12382
2026-03-27 20:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0168d43f-cbb3-5941-8422-07e258da95af with identifier: WP12382 to the API
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:37:27Z',
 'fuel_type': 'petrol',
 'id': '0168d43f-cbb3-5941-8422-07e258da95af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP12382',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 41903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-04',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo Turismo',
 'transmission': 'automatic',
 'trim': 'Turismo',
 'year': 2021}
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP12382%27 HTTP/1.1" 200 None
2026-03-27 20:31:39 [auto1.be] INFO: Saving data for WP12382: {'auction_closing_time': 1774715847.0, 'created_time': 1774438305.20587, 'last_price_update_time': 1774643499.040659}
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP12382') HTTP/1.1" 204 0
2026-03-27 20:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:39 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-27 20:31:39 [auto1.be] INFO: Scrape type for CS46874: 2
2026-03-27 20:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874
2026-03-27 20:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8a005ab-8638-5fcf-a703-140bcf3ce8af with scrape type 2
2026-03-27 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8a005ab-8638-5fcf-a703-140bcf3ce8af with scrape type 2
2026-03-27 20:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8a005ab-8638-5fcf-a703-140bcf3ce8af, identifier: CS46874
2026-03-27 20:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874
2026-03-27 20:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874
2026-03-27 20:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874 to the API
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:35:17Z',
 'fuel_type': 'petrol',
 'id': 'd8a005ab-8638-5fcf-a703-140bcf3ce8af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS46874',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 160033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-28',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2011}
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-27 20:31:39 [auto1.be] INFO: Saving data for CS46874: {'auction_closing_time': 1774715717.0, 'created_time': 1774557093.995115, 'last_price_update_time': 1774643499.500085}
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS46874') HTTP/1.1" 204 0
2026-03-27 20:31:39 [auto1.be] INFO: Found listing with ID: YC89583
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC89583%27 HTTP/1.1" 200 None
2026-03-27 20:31:39 [auto1.be] INFO: Scrape type for YC89583: 2
2026-03-27 20:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad4c8fb8-bbe7-510e-bf60-2960d24b821a with identifier: YC89583
2026-03-27 20:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad4c8fb8-bbe7-510e-bf60-2960d24b821a with scrape type 2
2026-03-27 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad4c8fb8-bbe7-510e-bf60-2960d24b821a with scrape type 2
2026-03-27 20:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ad4c8fb8-bbe7-510e-bf60-2960d24b821a, identifier: YC89583
2026-03-27 20:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ad4c8fb8-bbe7-510e-bf60-2960d24b821a with identifier: YC89583
2026-03-27 20:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ad4c8fb8-bbe7-510e-bf60-2960d24b821a with identifier: YC89583
2026-03-27 20:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ad4c8fb8-bbe7-510e-bf60-2960d24b821a with identifier: YC89583 to the API
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:09:15Z',
 'fuel_type': 'petrol',
 'id': 'ad4c8fb8-bbe7-510e-bf60-2960d24b821a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC89583',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 190747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-19',
 'seller_name': None,
 'title': 'Seat Leon 1.0 TSI Style Ecomotive',
 'transmission': 'automatic',
 'trim': 'Style Ecomotive',
 'year': 2018}
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC89583%27 HTTP/1.1" 200 None
2026-03-27 20:31:39 [auto1.be] INFO: Saving data for YC89583: {'auction_closing_time': 1774714155.0, 'created_time': 1774438263.529379, 'last_price_update_time': 1774643499.894876}
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YC89583') HTTP/1.1" 204 0
2026-03-27 20:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB51818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL89669> (referer: https://www.auto1.com/v1/car-details-view/FL89669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS62292> (referer: https://www.auto1.com/v1/car-details-view/YS62292/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a610b2d9-53a9-567b-b970-326603d7ef92 with identifier: FL89669
2026-03-27 20:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a610b2d9-53a9-567b-b970-326603d7ef92 with scrape type 1
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a610b2d9-53a9-567b-b970-326603d7ef92
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F6e%252Fe26eb36540a2d5b874675d156d3be943%252Fpa%252FFL89669_654fc5eb54775e86249adef8d90d661c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_654fc5eb54775e86249adef8d90d661c.jpg already downloaded
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F6e%252Fe26eb36540a2d5b874675d156d3be943%252Fpa%252FFL89669_5164deb8385f41f85295e7874734140e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_5164deb8385f41f85295e7874734140e.jpg already downloaded
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F6e%252Fe26eb36540a2d5b874675d156d3be943%252Fpa%252FFL89669_08d4e6c5508c5bf6561631295cfb2dd8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_08d4e6c5508c5bf6561631295cfb2dd8.jpg already downloaded
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F6e%252Fe26eb36540a2d5b874675d156d3be943%252Fpa%252FFL89669_1498778d951bd901aa4db91f588e1068.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_1498778d951bd901aa4db91f588e1068.jpg already downloaded
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F6e%252Fe26eb36540a2d5b874675d156d3be943%252Fpa%252FFL89669_25c4018e5aab4f2f16f3f6250e12b677.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_25c4018e5aab4f2f16f3f6250e12b677.jpg already downloaded
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F6e%252Fe26eb36540a2d5b874675d156d3be943%252Fpa%252FFL89669_90c558c29a74aca48823973453e040b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_90c558c29a74aca48823973453e040b1.jpg already downloaded
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F6e%252Fe26eb36540a2d5b874675d156d3be943%252Fpa%252FFL89669_aa5ffd21b991022ddb91cc12b6c5b0d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_aa5ffd21b991022ddb91cc12b6c5b0d6.jpg already downloaded
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F6e%252Fe26eb36540a2d5b874675d156d3be943%252Fpa%252FFL89669_f04551e6e9338abaa1295df224358eb2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_f04551e6e9338abaa1295df224358eb2.jpg already downloaded
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F6e%252Fe26eb36540a2d5b874675d156d3be943%252Fpa%252FFL89669_5eb11dd059ec5fc41dc842b6af6f86fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_5eb11dd059ec5fc41dc842b6af6f86fb.jpg already downloaded
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F6e%252Fe26eb36540a2d5b874675d156d3be943%252Fpa%252FFL89669_43fa54654c610cdf96a6acc0c580fbc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_43fa54654c610cdf96a6acc0c580fbc3.jpg already downloaded
2026-03-27 20:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a610b2d9-53a9-567b-b970-326603d7ef92, identifier: FL89669
2026-03-27 20:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a610b2d9-53a9-567b-b970-326603d7ef92 with identifier: FL89669
2026-03-27 20:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a610b2d9-53a9-567b-b970-326603d7ef92 with identifier: FL89669
2026-03-27 20:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a610b2d9-53a9-567b-b970-326603d7ef92 with identifier: FL89669 to the API
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FL89669>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:57:23Z',
 'fuel_type': 'diesel',
 'id': 'a610b2d9-53a9-567b-b970-326603d7ef92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL89669',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 269126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_654fc5eb54775e86249adef8d90d661c.jpg',
                'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_5164deb8385f41f85295e7874734140e.jpg',
                'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_08d4e6c5508c5bf6561631295cfb2dd8.jpg',
                'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_1498778d951bd901aa4db91f588e1068.jpg',
                'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_25c4018e5aab4f2f16f3f6250e12b677.jpg',
                'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_90c558c29a74aca48823973453e040b1.jpg',
                'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_aa5ffd21b991022ddb91cc12b6c5b0d6.jpg',
                'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_f04551e6e9338abaa1295df224358eb2.jpg',
                'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_5eb11dd059ec5fc41dc842b6af6f86fb.jpg',
                'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_43fa54654c610cdf96a6acc0c580fbc3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610b2d9-53a9-567b-b970-326603d7ef92/a610b2d9-53a9-567b-b970-326603d7ef92_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_654fc5eb54775e86249adef8d90d661c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610b2d9-53a9-567b-b970-326603d7ef92/a610b2d9-53a9-567b-b970-326603d7ef92_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_5164deb8385f41f85295e7874734140e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610b2d9-53a9-567b-b970-326603d7ef92/a610b2d9-53a9-567b-b970-326603d7ef92_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_08d4e6c5508c5bf6561631295cfb2dd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610b2d9-53a9-567b-b970-326603d7ef92/a610b2d9-53a9-567b-b970-326603d7ef92_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_1498778d951bd901aa4db91f588e1068.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610b2d9-53a9-567b-b970-326603d7ef92/a610b2d9-53a9-567b-b970-326603d7ef92_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_25c4018e5aab4f2f16f3f6250e12b677.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610b2d9-53a9-567b-b970-326603d7ef92/a610b2d9-53a9-567b-b970-326603d7ef92_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_90c558c29a74aca48823973453e040b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610b2d9-53a9-567b-b970-326603d7ef92/a610b2d9-53a9-567b-b970-326603d7ef92_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_aa5ffd21b991022ddb91cc12b6c5b0d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610b2d9-53a9-567b-b970-326603d7ef92/a610b2d9-53a9-567b-b970-326603d7ef92_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_f04551e6e9338abaa1295df224358eb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610b2d9-53a9-567b-b970-326603d7ef92/a610b2d9-53a9-567b-b970-326603d7ef92_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_5eb11dd059ec5fc41dc842b6af6f86fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610b2d9-53a9-567b-b970-326603d7ef92/a610b2d9-53a9-567b-b970-326603d7ef92_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/6e/e26eb36540a2d5b874675d156d3be943/pa/FL89669_43fa54654c610cdf96a6acc0c580fbc3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-31',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 HDi 35 L3H2 Profi',
 'transmission': 'manual',
 'trim': '35 L3H2 Profi',
 'year': 2015}
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL89669%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [auto1.be] INFO: Saving data for FL89669: {'created_time': 1774643501.614709, 'last_price_update_time': 1774643501.614721, 'auction_closing_time': 1774717043.0}
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FL89669') HTTP/1.1" 204 0
2026-03-27 20:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18586cd4-ba0d-50f5-b565-14fa169d5641 with identifier: YS62292
2026-03-27 20:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18586cd4-ba0d-50f5-b565-14fa169d5641 with scrape type 1
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18586cd4-ba0d-50f5-b565-14fa169d5641
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_a34c70e0a9448860a3aa2fbe9f100f5d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_a34c70e0a9448860a3aa2fbe9f100f5d.jpg not downloaded yet
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_790ff928e83b60a528cbb04f39beb4b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_790ff928e83b60a528cbb04f39beb4b5.jpg not downloaded yet
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_cc23394fdb87d9ae04fe744221dd2845.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_cc23394fdb87d9ae04fe744221dd2845.jpg not downloaded yet
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_88a734c0c5a77e5f89b03294191f6825.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_88a734c0c5a77e5f89b03294191f6825.jpg not downloaded yet
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_cf69724066ce817828d6b2486438c1f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_cf69724066ce817828d6b2486438c1f6.jpg not downloaded yet
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_0cf3b3dad5176d2e37e299de9f83f4e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_0cf3b3dad5176d2e37e299de9f83f4e4.jpg not downloaded yet
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_abd6bcdfa7fbfe49c18837a68ba28175.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_abd6bcdfa7fbfe49c18837a68ba28175.jpg not downloaded yet
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_a3a90ea99a82a21688b8e19bf3cad4f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_a3a90ea99a82a21688b8e19bf3cad4f1.jpg not downloaded yet
2026-03-27 20:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_a34c70e0a9448860a3aa2fbe9f100f5d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_7b65de6c62928d9e5cd991162a13a812.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_7b65de6c62928d9e5cd991162a13a812.jpg not downloaded yet
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_def37ffba5b28bd6244982e5c30375a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_def37ffba5b28bd6244982e5c30375a1.jpg not downloaded yet
2026-03-27 20:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_cc23394fdb87d9ae04fe744221dd2845.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35345d550>
2026-03-27 20:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_a34c70e0a9448860a3aa2fbe9f100f5d.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_a34c70e0a9448860a3aa2fbe9f100f5d.jpg saved to cache
2026-03-27 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18586cd4-ba0d-50f5-b565-14fa169d5641
2026-03-27 20:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_abd6bcdfa7fbfe49c18837a68ba28175.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_def37ffba5b28bd6244982e5c30375a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bdbc50>
2026-03-27 20:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_cc23394fdb87d9ae04fe744221dd2845.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_cc23394fdb87d9ae04fe744221dd2845.jpg saved to cache
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18586cd4-ba0d-50f5-b565-14fa169d5641
2026-03-27 20:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_790ff928e83b60a528cbb04f39beb4b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_88a734c0c5a77e5f89b03294191f6825.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_a3a90ea99a82a21688b8e19bf3cad4f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_0cf3b3dad5176d2e37e299de9f83f4e4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_cf69724066ce817828d6b2486438c1f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_7b65de6c62928d9e5cd991162a13a812.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b43f10>
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_abd6bcdfa7fbfe49c18837a68ba28175.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_abd6bcdfa7fbfe49c18837a68ba28175.jpg saved to cache
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18586cd4-ba0d-50f5-b565-14fa169d5641
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf4cd0>
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_def37ffba5b28bd6244982e5c30375a1.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_def37ffba5b28bd6244982e5c30375a1.jpg saved to cache
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18586cd4-ba0d-50f5-b565-14fa169d5641
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35953ead0>
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_790ff928e83b60a528cbb04f39beb4b5.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_790ff928e83b60a528cbb04f39beb4b5.jpg saved to cache
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18586cd4-ba0d-50f5-b565-14fa169d5641
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b38390>
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_88a734c0c5a77e5f89b03294191f6825.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_88a734c0c5a77e5f89b03294191f6825.jpg saved to cache
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18586cd4-ba0d-50f5-b565-14fa169d5641
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353687290>
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_a3a90ea99a82a21688b8e19bf3cad4f1.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_a3a90ea99a82a21688b8e19bf3cad4f1.jpg saved to cache
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18586cd4-ba0d-50f5-b565-14fa169d5641
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35354dd50>
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_0cf3b3dad5176d2e37e299de9f83f4e4.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_0cf3b3dad5176d2e37e299de9f83f4e4.jpg saved to cache
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18586cd4-ba0d-50f5-b565-14fa169d5641
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf7d90>
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_cf69724066ce817828d6b2486438c1f6.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_cf69724066ce817828d6b2486438c1f6.jpg saved to cache
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18586cd4-ba0d-50f5-b565-14fa169d5641
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bc0090>
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fe9%252F59e9e16ce016f8e9d27528188b465bc2%252Fpa%252FYS62292_7b65de6c62928d9e5cd991162a13a812.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_7b65de6c62928d9e5cd991162a13a812.jpg saved to cache
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18586cd4-ba0d-50f5-b565-14fa169d5641
2026-03-27 20:31:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18586cd4-ba0d-50f5-b565-14fa169d5641, skipping ID generation
2026-03-27 20:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18586cd4-ba0d-50f5-b565-14fa169d5641 with scrape type 1
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18586cd4-ba0d-50f5-b565-14fa169d5641 sending to next pipeline
2026-03-27 20:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18586cd4-ba0d-50f5-b565-14fa169d5641, identifier: YS62292
2026-03-27 20:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18586cd4-ba0d-50f5-b565-14fa169d5641 with identifier: YS62292
2026-03-27 20:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18586cd4-ba0d-50f5-b565-14fa169d5641 with identifier: YS62292
2026-03-27 20:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18586cd4-ba0d-50f5-b565-14fa169d5641 with identifier: YS62292 to the API
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_7b65de6c62928d9e5cd991162a13a812.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:20:09Z',
 'fuel_type': 'petrol',
 'id': '18586cd4-ba0d-50f5-b565-14fa169d5641',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS62292',
 'listing': 'auction',
 'location': 'BE, Drogenbos',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 26357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 36,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_a34c70e0a9448860a3aa2fbe9f100f5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_790ff928e83b60a528cbb04f39beb4b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_cc23394fdb87d9ae04fe744221dd2845.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_88a734c0c5a77e5f89b03294191f6825.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_cf69724066ce817828d6b2486438c1f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_0cf3b3dad5176d2e37e299de9f83f4e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_abd6bcdfa7fbfe49c18837a68ba28175.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_a3a90ea99a82a21688b8e19bf3cad4f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_7b65de6c62928d9e5cd991162a13a812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18586cd4-ba0d-50f5-b565-14fa169d5641/18586cd4-ba0d-50f5-b565-14fa169d5641_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/e9/59e9e16ce016f8e9d27528188b465bc2/pa/YS62292_def37ffba5b28bd6244982e5c30375a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2022}
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS62292%27 HTTP/1.1" 200 None
2026-03-27 20:31:42 [auto1.be] INFO: Saving data for YS62292: {'created_time': 1774643502.798586, 'last_price_update_time': 1774643502.798596, 'auction_closing_time': 1774714809.0}
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS62292') HTTP/1.1" 204 0
2026-03-27 20:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB51818> (referer: https://www.auto1.com/v1/car-details-view/CB51818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7971f721-4ccc-5f4a-bfb5-103d9606c44a with identifier: CB51818
2026-03-27 20:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a with scrape type 1
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_de072854e8d8376479ac60ada1b96208.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_de072854e8d8376479ac60ada1b96208.jpg not downloaded yet
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_82ea37ac0c4146369c0bb0159672809e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_82ea37ac0c4146369c0bb0159672809e.jpg not downloaded yet
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_30678aaa2678dba3b8d7115620e05aca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_30678aaa2678dba3b8d7115620e05aca.jpg not downloaded yet
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_a15d4e9ca96b5f0748ab62ca2c663b4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_a15d4e9ca96b5f0748ab62ca2c663b4a.jpg not downloaded yet
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_cc1b186124eebc5cde04d6cd2d4dffbc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_cc1b186124eebc5cde04d6cd2d4dffbc.jpg not downloaded yet
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_1cfe4904e47a985bf27ef0bb3eecc836.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_1cfe4904e47a985bf27ef0bb3eecc836.jpg not downloaded yet
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_f71f71663c28c81ea303cfd12efb6bd4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_f71f71663c28c81ea303cfd12efb6bd4.jpg not downloaded yet
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_471a56c18912d8ab79f27508c9414636.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_471a56c18912d8ab79f27508c9414636.jpg not downloaded yet
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_589cda2284feb312212a97aae9797b87.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_589cda2284feb312212a97aae9797b87.jpg not downloaded yet
2026-03-27 20:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_82ea37ac0c4146369c0bb0159672809e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_eea1fe147d0221a0f9520d0edb9cd9f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_eea1fe147d0221a0f9520d0edb9cd9f4.jpg not downloaded yet
2026-03-27 20:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_a15d4e9ca96b5f0748ab62ca2c663b4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_cc1b186124eebc5cde04d6cd2d4dffbc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_1cfe4904e47a985bf27ef0bb3eecc836.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_589cda2284feb312212a97aae9797b87.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_eea1fe147d0221a0f9520d0edb9cd9f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_f71f71663c28c81ea303cfd12efb6bd4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_471a56c18912d8ab79f27508c9414636.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bc2ad0>
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_82ea37ac0c4146369c0bb0159672809e.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_82ea37ac0c4146369c0bb0159672809e.jpg saved to cache
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353577510>
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_a15d4e9ca96b5f0748ab62ca2c663b4a.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_a15d4e9ca96b5f0748ab62ca2c663b4a.jpg saved to cache
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35351f850>
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_cc1b186124eebc5cde04d6cd2d4dffbc.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_cc1b186124eebc5cde04d6cd2d4dffbc.jpg saved to cache
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534aa650>
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_1cfe4904e47a985bf27ef0bb3eecc836.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_1cfe4904e47a985bf27ef0bb3eecc836.jpg saved to cache
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a
2026-03-27 20:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_30678aaa2678dba3b8d7115620e05aca.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353473510>
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_589cda2284feb312212a97aae9797b87.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_589cda2284feb312212a97aae9797b87.jpg saved to cache
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35344a190>
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_eea1fe147d0221a0f9520d0edb9cd9f4.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_eea1fe147d0221a0f9520d0edb9cd9f4.jpg saved to cache
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a10bd0>
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_f71f71663c28c81ea303cfd12efb6bd4.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_f71f71663c28c81ea303cfd12efb6bd4.jpg saved to cache
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35351cd10>
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_471a56c18912d8ab79f27508c9414636.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_471a56c18912d8ab79f27508c9414636.jpg saved to cache
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353684790>
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_30678aaa2678dba3b8d7115620e05aca.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_30678aaa2678dba3b8d7115620e05aca.jpg saved to cache
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a
2026-03-27 20:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_de072854e8d8376479ac60ada1b96208.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:31:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:31:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:31:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:31:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3535cabd0>
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F3c%252F653cb5ab713d6d28bd5ba17e83dfec15%252Fpa%252FCB51818_de072854e8d8376479ac60ada1b96208.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_de072854e8d8376479ac60ada1b96208.jpg saved to cache
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a
2026-03-27 20:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7971f721-4ccc-5f4a-bfb5-103d9606c44a, skipping ID generation
2026-03-27 20:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a with scrape type 1
2026-03-27 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7971f721-4ccc-5f4a-bfb5-103d9606c44a sending to next pipeline
2026-03-27 20:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7971f721-4ccc-5f4a-bfb5-103d9606c44a, identifier: CB51818
2026-03-27 20:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7971f721-4ccc-5f4a-bfb5-103d9606c44a with identifier: CB51818
2026-03-27 20:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7971f721-4ccc-5f4a-bfb5-103d9606c44a with identifier: CB51818
2026-03-27 20:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7971f721-4ccc-5f4a-bfb5-103d9606c44a with identifier: CB51818 to the API
2026-03-27 20:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_de072854e8d8376479ac60ada1b96208.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:43:20Z',
 'fuel_type': 'diesel',
 'id': '7971f721-4ccc-5f4a-bfb5-103d9606c44a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB51818',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 157173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3394490,
             'Height': 4284,
             'OriginUrl': 'https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_de072854e8d8376479ac60ada1b96208.jpg',
             'Width': 5712},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_82ea37ac0c4146369c0bb0159672809e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_30678aaa2678dba3b8d7115620e05aca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_a15d4e9ca96b5f0748ab62ca2c663b4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_cc1b186124eebc5cde04d6cd2d4dffbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_1cfe4904e47a985bf27ef0bb3eecc836.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_f71f71663c28c81ea303cfd12efb6bd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_471a56c18912d8ab79f27508c9414636.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_589cda2284feb312212a97aae9797b87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7971f721-4ccc-5f4a-bfb5-103d9606c44a/7971f721-4ccc-5f4a-bfb5-103d9606c44a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/3c/653cb5ab713d6d28bd5ba17e83dfec15/pa/CB51818_eea1fe147d0221a0f9520d0edb9cd9f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2008}
2026-03-27 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB51818%27 HTTP/1.1" 200 None
2026-03-27 20:31:44 [auto1.be] INFO: Saving data for CB51818: {'created_time': 1774643504.239092, 'last_price_update_time': 1774643504.239103, 'auction_closing_time': 1774716200.0}
2026-03-27 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB51818') HTTP/1.1" 204 0
2026-03-27 20:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK81343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK81343> (referer: https://www.auto1.com/v1/car-details-view/FK81343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b with identifier: FK81343
2026-03-27 20:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b with scrape type 1
2026-03-27 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_ddfa5d196f81d354ac9c4371432b8d71.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_ddfa5d196f81d354ac9c4371432b8d71.jpg not downloaded yet
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_d8b0cef5d4f19d55c24f1c9287df7737.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_d8b0cef5d4f19d55c24f1c9287df7737.jpg not downloaded yet
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_485e2a9296d03999d646354c38645801.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_485e2a9296d03999d646354c38645801.jpg not downloaded yet
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_1442a1e59c6c38e713cafde057517f63.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_1442a1e59c6c38e713cafde057517f63.jpg not downloaded yet
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_fae7c683607bd5a160d91cd29c2fe1bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_fae7c683607bd5a160d91cd29c2fe1bb.jpg not downloaded yet
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_8cead67816cb38a9b3c6da798b48dea8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_8cead67816cb38a9b3c6da798b48dea8.jpg not downloaded yet
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_04c95280ce807f42a82ae89491bcd37f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_04c95280ce807f42a82ae89491bcd37f.jpg not downloaded yet
2026-03-27 20:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_d8b0cef5d4f19d55c24f1c9287df7737.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_ddfa5d196f81d354ac9c4371432b8d71.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_35fdac06d23b871dca158e83347a66ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_35fdac06d23b871dca158e83347a66ee.jpg not downloaded yet
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_2eda13c263b00d320a637bc7818ca963.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_2eda13c263b00d320a637bc7818ca963.jpg not downloaded yet
2026-03-27 20:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_1442a1e59c6c38e713cafde057517f63.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_31452887999f744e4057c13be0916ef8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_31452887999f744e4057c13be0916ef8.jpg not downloaded yet
2026-03-27 20:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_8cead67816cb38a9b3c6da798b48dea8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_485e2a9296d03999d646354c38645801.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_fae7c683607bd5a160d91cd29c2fe1bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35351b290>
2026-03-27 20:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_d8b0cef5d4f19d55c24f1c9287df7737.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_d8b0cef5d4f19d55c24f1c9287df7737.jpg saved to cache
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353495b10>
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_ddfa5d196f81d354ac9c4371432b8d71.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_ddfa5d196f81d354ac9c4371432b8d71.jpg saved to cache
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b
2026-03-27 20:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_35fdac06d23b871dca158e83347a66ee.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_2eda13c263b00d320a637bc7818ca963.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_31452887999f744e4057c13be0916ef8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353563310>
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_1442a1e59c6c38e713cafde057517f63.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_1442a1e59c6c38e713cafde057517f63.jpg saved to cache
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35348de90>
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_8cead67816cb38a9b3c6da798b48dea8.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_8cead67816cb38a9b3c6da798b48dea8.jpg saved to cache
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536903d0>
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_485e2a9296d03999d646354c38645801.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_485e2a9296d03999d646354c38645801.jpg saved to cache
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353431d50>
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_fae7c683607bd5a160d91cd29c2fe1bb.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_fae7c683607bd5a160d91cd29c2fe1bb.jpg saved to cache
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b
2026-03-27 20:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_04c95280ce807f42a82ae89491bcd37f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353548fd0>
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_35fdac06d23b871dca158e83347a66ee.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_35fdac06d23b871dca158e83347a66ee.jpg saved to cache
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3535c5d10>
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_2eda13c263b00d320a637bc7818ca963.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_2eda13c263b00d320a637bc7818ca963.jpg saved to cache
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bd9190>
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_31452887999f744e4057c13be0916ef8.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_31452887999f744e4057c13be0916ef8.jpg saved to cache
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353481a90>
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de373017a1b723256e79c1bc8ea451%252Fpa%252FFK81343_04c95280ce807f42a82ae89491bcd37f.jpg') HTTP/1.1" 204 0
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_04c95280ce807f42a82ae89491bcd37f.jpg saved to cache
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b
2026-03-27 20:31:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b, skipping ID generation
2026-03-27 20:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b with scrape type 1
2026-03-27 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b sending to next pipeline
2026-03-27 20:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b, identifier: FK81343
2026-03-27 20:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b with identifier: FK81343
2026-03-27 20:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b with identifier: FK81343
2026-03-27 20:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b with identifier: FK81343 to the API
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_04c95280ce807f42a82ae89491bcd37f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:32:50Z',
 'fuel_type': 'diesel',
 'id': '8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK81343',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 163365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_ddfa5d196f81d354ac9c4371432b8d71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_d8b0cef5d4f19d55c24f1c9287df7737.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_485e2a9296d03999d646354c38645801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_1442a1e59c6c38e713cafde057517f63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_fae7c683607bd5a160d91cd29c2fe1bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_8cead67816cb38a9b3c6da798b48dea8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_04c95280ce807f42a82ae89491bcd37f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_35fdac06d23b871dca158e83347a66ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_2eda13c263b00d320a637bc7818ca963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b/8d6c8f31-1e8a-5b62-91bb-5a21fbd0cd2b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de373017a1b723256e79c1bc8ea451/pa/FK81343_31452887999f744e4057c13be0916ef8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.2 Sd4 HSE Luxury',
 'transmission': 'automatic',
 'trim': 'HSE Luxury',
 'year': 2015}
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK81343%27 HTTP/1.1" 200 None
2026-03-27 20:31:46 [auto1.be] INFO: Saving data for FK81343: {'created_time': 1774643506.922737, 'last_price_update_time': 1774643506.922747, 'auction_closing_time': 1774715570.0}
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FK81343') HTTP/1.1" 204 0
2026-03-27 20:32:06 [scrapy.extensions.logstats] INFO: Crawled 62 pages (at 27 pages/min), scraped 126 items (at 50 items/min)
2026-03-27 20:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 166MiB
2026-03-27 20:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:07 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1659 | hits on page: 40
2026-03-27 20:32:07 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-27 20:32:07 [auto1.be] INFO: Scrape type for SU72836: 2
2026-03-27 20:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836
2026-03-27 20:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with scrape type 2
2026-03-27 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with scrape type 2
2026-03-27 20:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b48de29-6c3c-5d19-996d-b67f94e8fa83, identifier: SU72836
2026-03-27 20:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836
2026-03-27 20:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836
2026-03-27 20:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836 to the API
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:11:57Z',
 'fuel_type': 'diesel',
 'id': '1b48de29-6c3c-5d19-996d-b67f94e8fa83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU72836',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 136454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-07',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.6 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-27 20:32:07 [auto1.be] INFO: Saving data for SU72836: {'auction_closing_time': 1774714317.0, 'created_time': 1773922343.923508, 'last_price_update_time': 1774643527.603922}
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SU72836') HTTP/1.1" 204 0
2026-03-27 20:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:07 [auto1.be] INFO: Found listing with ID: GS05336
2026-03-27 20:32:07 [auto1.be] INFO: Found listing with ID: XB71990
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB71990%27 HTTP/1.1" 200 None
2026-03-27 20:32:07 [auto1.be] INFO: Scrape type for XB71990: 0
2026-03-27 20:32:07 [auto1.be] INFO: Found listing with ID: JE75068
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE75068%27 HTTP/1.1" 200 None
2026-03-27 20:32:07 [auto1.be] INFO: Scrape type for JE75068: 0
2026-03-27 20:32:07 [auto1.be] INFO: Found listing with ID: JU70188
2026-03-27 20:32:07 [auto1.be] INFO: Found listing with ID: EB16456
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB16456%27 HTTP/1.1" 200 None
2026-03-27 20:32:07 [auto1.be] INFO: Scrape type for EB16456: 2
2026-03-27 20:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96f3744e-77c3-5417-b891-2a49278147f5 with identifier: EB16456
2026-03-27 20:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96f3744e-77c3-5417-b891-2a49278147f5 with scrape type 2
2026-03-27 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96f3744e-77c3-5417-b891-2a49278147f5 with scrape type 2
2026-03-27 20:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96f3744e-77c3-5417-b891-2a49278147f5, identifier: EB16456
2026-03-27 20:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96f3744e-77c3-5417-b891-2a49278147f5 with identifier: EB16456
2026-03-27 20:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96f3744e-77c3-5417-b891-2a49278147f5 with identifier: EB16456
2026-03-27 20:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96f3744e-77c3-5417-b891-2a49278147f5 with identifier: EB16456 to the API
2026-03-27 20:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:58:43Z',
 'fuel_type': 'diesel',
 'id': '96f3744e-77c3-5417-b891-2a49278147f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB16456',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 126593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2020}
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB16456%27 HTTP/1.1" 200 None
2026-03-27 20:32:08 [auto1.be] INFO: Saving data for EB16456: {'auction_closing_time': 1774717123.0, 'created_time': 1773238447.332007, 'last_price_update_time': 1774643528.219461}
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EB16456') HTTP/1.1" 204 0
2026-03-27 20:32:08 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-27 20:32:08 [auto1.be] INFO: Scrape type for DW89258: 2
2026-03-27 20:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258
2026-03-27 20:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52248d4a-e6ea-5101-8ddf-fea58ffe956a with scrape type 2
2026-03-27 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52248d4a-e6ea-5101-8ddf-fea58ffe956a with scrape type 2
2026-03-27 20:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 52248d4a-e6ea-5101-8ddf-fea58ffe956a, identifier: DW89258
2026-03-27 20:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258
2026-03-27 20:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258
2026-03-27 20:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258 to the API
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:41:13Z',
 'fuel_type': 'petrol',
 'id': '52248d4a-e6ea-5101-8ddf-fea58ffe956a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW89258',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 118026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2018}
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-27 20:32:08 [auto1.be] INFO: Saving data for DW89258: {'auction_closing_time': 1774716073.0, 'created_time': 1774557026.899328, 'last_price_update_time': 1774643528.712105}
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW89258') HTTP/1.1" 204 0
2026-03-27 20:32:08 [auto1.be] INFO: Found listing with ID: EU07402
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU07402%27 HTTP/1.1" 200 None
2026-03-27 20:32:08 [auto1.be] INFO: Scrape type for EU07402: 2
2026-03-27 20:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 594bd27c-a02b-58f6-82d7-5223f810936c with identifier: EU07402
2026-03-27 20:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 594bd27c-a02b-58f6-82d7-5223f810936c with scrape type 2
2026-03-27 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 594bd27c-a02b-58f6-82d7-5223f810936c with scrape type 2
2026-03-27 20:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 594bd27c-a02b-58f6-82d7-5223f810936c, identifier: EU07402
2026-03-27 20:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 594bd27c-a02b-58f6-82d7-5223f810936c with identifier: EU07402
2026-03-27 20:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 594bd27c-a02b-58f6-82d7-5223f810936c with identifier: EU07402
2026-03-27 20:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 594bd27c-a02b-58f6-82d7-5223f810936c with identifier: EU07402 to the API
2026-03-27 20:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:47:40Z',
 'fuel_type': 'hybrid',
 'id': '594bd27c-a02b-58f6-82d7-5223f810936c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU07402',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 115726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU07402%27 HTTP/1.1" 200 None
2026-03-27 20:32:09 [auto1.be] INFO: Saving data for EU07402: {'auction_closing_time': 1774716460.0, 'created_time': 1774438329.16901, 'last_price_update_time': 1774643529.116277}
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EU07402') HTTP/1.1" 204 0
2026-03-27 20:32:09 [auto1.be] INFO: Found listing with ID: YK96520
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK96520%27 HTTP/1.1" 200 None
2026-03-27 20:32:09 [auto1.be] INFO: Scrape type for YK96520: 0
2026-03-27 20:32:09 [auto1.be] INFO: Found listing with ID: UJ88717
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ88717%27 HTTP/1.1" 200 None
2026-03-27 20:32:09 [auto1.be] INFO: Scrape type for UJ88717: 2
2026-03-27 20:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32192085-ebf9-558f-ab8c-01f8940eafd1 with identifier: UJ88717
2026-03-27 20:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32192085-ebf9-558f-ab8c-01f8940eafd1 with scrape type 2
2026-03-27 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32192085-ebf9-558f-ab8c-01f8940eafd1 with scrape type 2
2026-03-27 20:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 32192085-ebf9-558f-ab8c-01f8940eafd1, identifier: UJ88717
2026-03-27 20:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 32192085-ebf9-558f-ab8c-01f8940eafd1 with identifier: UJ88717
2026-03-27 20:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 32192085-ebf9-558f-ab8c-01f8940eafd1 with identifier: UJ88717
2026-03-27 20:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 32192085-ebf9-558f-ab8c-01f8940eafd1 with identifier: UJ88717 to the API
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:20:09Z',
 'fuel_type': 'diesel',
 'id': '32192085-ebf9-558f-ab8c-01f8940eafd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ88717',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 276316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-05',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ88717%27 HTTP/1.1" 200 None
2026-03-27 20:32:09 [auto1.be] INFO: Saving data for UJ88717: {'auction_closing_time': 1774714809.0, 'created_time': 1774438254.413601, 'last_price_update_time': 1774643529.52872}
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UJ88717') HTTP/1.1" 204 0
2026-03-27 20:32:09 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-27 20:32:09 [auto1.be] INFO: Scrape type for LK29098: 0
2026-03-27 20:32:09 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-27 20:32:09 [auto1.be] INFO: Scrape type for UV91092: 0
2026-03-27 20:32:09 [auto1.be] INFO: Found listing with ID: TT89669
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT89669%27 HTTP/1.1" 200 None
2026-03-27 20:32:09 [auto1.be] INFO: Scrape type for TT89669: 0
2026-03-27 20:32:09 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-27 20:32:09 [auto1.be] INFO: Scrape type for CF04837: 0
2026-03-27 20:32:09 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-27 20:32:09 [auto1.be] INFO: Found listing with ID: RK84429
2026-03-27 20:32:09 [auto1.be] INFO: Found listing with ID: DK31159
2026-03-27 20:32:09 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-27 20:32:09 [auto1.be] INFO: Found listing with ID: CP91867
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91867%27 HTTP/1.1" 200 None
2026-03-27 20:32:09 [auto1.be] INFO: Scrape type for CP91867: 2
2026-03-27 20:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e073263-2c64-58dd-a52f-c3d18b337603 with identifier: CP91867
2026-03-27 20:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e073263-2c64-58dd-a52f-c3d18b337603 with scrape type 2
2026-03-27 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e073263-2c64-58dd-a52f-c3d18b337603 with scrape type 2
2026-03-27 20:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e073263-2c64-58dd-a52f-c3d18b337603, identifier: CP91867
2026-03-27 20:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e073263-2c64-58dd-a52f-c3d18b337603 with identifier: CP91867
2026-03-27 20:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e073263-2c64-58dd-a52f-c3d18b337603 with identifier: CP91867
2026-03-27 20:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e073263-2c64-58dd-a52f-c3d18b337603 with identifier: CP91867 to the API
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:34:26Z',
 'fuel_type': 'petrol',
 'id': '0e073263-2c64-58dd-a52f-c3d18b337603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP91867',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 109071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-19',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91867%27 HTTP/1.1" 200 None
2026-03-27 20:32:10 [auto1.be] INFO: Saving data for CP91867: {'auction_closing_time': 1774715666.0, 'created_time': 1773347505.691885, 'last_price_update_time': 1774643530.069249}
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP91867') HTTP/1.1" 204 0
2026-03-27 20:32:10 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-27 20:32:10 [auto1.be] INFO: Scrape type for GR78986: 0
2026-03-27 20:32:10 [auto1.be] INFO: Found listing with ID: DV43116
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV43116%27 HTTP/1.1" 200 None
2026-03-27 20:32:10 [auto1.be] INFO: Scrape type for DV43116: 2
2026-03-27 20:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9d08f64-814b-5a3d-aeb3-4e769424a7ab with identifier: DV43116
2026-03-27 20:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9d08f64-814b-5a3d-aeb3-4e769424a7ab with scrape type 2
2026-03-27 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9d08f64-814b-5a3d-aeb3-4e769424a7ab with scrape type 2
2026-03-27 20:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a9d08f64-814b-5a3d-aeb3-4e769424a7ab, identifier: DV43116
2026-03-27 20:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a9d08f64-814b-5a3d-aeb3-4e769424a7ab with identifier: DV43116
2026-03-27 20:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a9d08f64-814b-5a3d-aeb3-4e769424a7ab with identifier: DV43116
2026-03-27 20:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a9d08f64-814b-5a3d-aeb3-4e769424a7ab with identifier: DV43116 to the API
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:44:49Z',
 'fuel_type': 'diesel',
 'id': 'a9d08f64-814b-5a3d-aeb3-4e769424a7ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV43116',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 128442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-02',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV43116%27 HTTP/1.1" 200 None
2026-03-27 20:32:10 [auto1.be] INFO: Saving data for DV43116: {'auction_closing_time': 1774716289.0, 'created_time': 1774438329.569206, 'last_price_update_time': 1774643530.461609}
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DV43116') HTTP/1.1" 204 0
2026-03-27 20:32:10 [auto1.be] INFO: Found listing with ID: UA36562
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36562%27 HTTP/1.1" 200 None
2026-03-27 20:32:10 [auto1.be] INFO: Scrape type for UA36562: 2
2026-03-27 20:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b25a8ae6-0919-5c5a-8abc-443b3693ec55 with identifier: UA36562
2026-03-27 20:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b25a8ae6-0919-5c5a-8abc-443b3693ec55 with scrape type 2
2026-03-27 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b25a8ae6-0919-5c5a-8abc-443b3693ec55 with scrape type 2
2026-03-27 20:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b25a8ae6-0919-5c5a-8abc-443b3693ec55, identifier: UA36562
2026-03-27 20:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b25a8ae6-0919-5c5a-8abc-443b3693ec55 with identifier: UA36562
2026-03-27 20:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b25a8ae6-0919-5c5a-8abc-443b3693ec55 with identifier: UA36562
2026-03-27 20:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b25a8ae6-0919-5c5a-8abc-443b3693ec55 with identifier: UA36562 to the API
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:53:05Z',
 'fuel_type': 'diesel',
 'id': 'b25a8ae6-0919-5c5a-8abc-443b3693ec55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA36562',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 234963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-16',
 'seller_name': None,
 'title': 'BMW 4er 420d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36562%27 HTTP/1.1" 200 None
2026-03-27 20:32:10 [auto1.be] INFO: Saving data for UA36562: {'auction_closing_time': 1774716785.0, 'created_time': 1773301772.60098, 'last_price_update_time': 1774643530.932402}
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA36562') HTTP/1.1" 204 0
2026-03-27 20:32:10 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-27 20:32:10 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-27 20:32:10 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-27 20:32:10 [auto1.be] INFO: Scrape type for KV94769: 0
2026-03-27 20:32:10 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-27 20:32:10 [auto1.be] INFO: Scrape type for DU38710: 0
2026-03-27 20:32:10 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-27 20:32:11 [auto1.be] INFO: Scrape type for NS73936: 0
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: CF07146
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF07146%27 HTTP/1.1" 200 None
2026-03-27 20:32:11 [auto1.be] INFO: Scrape type for CF07146: 2
2026-03-27 20:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a2bab15-8266-5f74-a5e5-d508708c0ac6 with identifier: CF07146
2026-03-27 20:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a2bab15-8266-5f74-a5e5-d508708c0ac6 with scrape type 2
2026-03-27 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a2bab15-8266-5f74-a5e5-d508708c0ac6 with scrape type 2
2026-03-27 20:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a2bab15-8266-5f74-a5e5-d508708c0ac6, identifier: CF07146
2026-03-27 20:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a2bab15-8266-5f74-a5e5-d508708c0ac6 with identifier: CF07146
2026-03-27 20:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a2bab15-8266-5f74-a5e5-d508708c0ac6 with identifier: CF07146
2026-03-27 20:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a2bab15-8266-5f74-a5e5-d508708c0ac6 with identifier: CF07146 to the API
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:58:53Z',
 'fuel_type': 'diesel',
 'id': '7a2bab15-8266-5f74-a5e5-d508708c0ac6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF07146',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 357460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-01',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF07146%27 HTTP/1.1" 200 None
2026-03-27 20:32:11 [auto1.be] INFO: Saving data for CF07146: {'auction_closing_time': 1774717133.0, 'created_time': 1774438277.905887, 'last_price_update_time': 1774643531.375281}
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CF07146') HTTP/1.1" 204 0
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: MU76581
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: GJ15610
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ15610%27 HTTP/1.1" 200 None
2026-03-27 20:32:11 [auto1.be] INFO: Scrape type for GJ15610: 0
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: MG19472
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG19472%27 HTTP/1.1" 200 None
2026-03-27 20:32:11 [auto1.be] INFO: Scrape type for MG19472: 0
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-27 20:32:11 [auto1.be] INFO: Scrape type for KP16725: 1
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: MR50383
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR50383%27 HTTP/1.1" 200 None
2026-03-27 20:32:11 [auto1.be] INFO: Scrape type for MR50383: 0
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: EJ45818
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: WX63908
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: RL53364
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: NM48533
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM48533%27 HTTP/1.1" 200 None
2026-03-27 20:32:11 [auto1.be] INFO: Scrape type for NM48533: 0
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: VZ37622
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ37622%27 HTTP/1.1" 200 None
2026-03-27 20:32:11 [auto1.be] INFO: Scrape type for VZ37622: 0
2026-03-27 20:32:11 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-27 20:32:11 [auto1.be] INFO: Scrape type for CS76215: 2
2026-03-27 20:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215
2026-03-27 20:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with scrape type 2
2026-03-27 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with scrape type 2
2026-03-27 20:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af, identifier: CS76215
2026-03-27 20:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215
2026-03-27 20:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215
2026-03-27 20:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215 to the API
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:45:20Z',
 'fuel_type': 'petrol',
 'id': '41cb4f8b-3f47-5e1f-93ef-6b7506c322af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS76215',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 115278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-06',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2020}
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-27 20:32:11 [auto1.be] INFO: Saving data for CS76215: {'auction_closing_time': 1774716320.0, 'created_time': 1774557107.100583, 'last_price_update_time': 1774643531.928448}
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS76215') HTTP/1.1" 204 0
2026-03-27 20:32:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:12 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1659 | hits on page: 40
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: SM52966
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-27 20:32:12 [auto1.be] INFO: Scrape type for WL68728: 0
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: WV71876
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV71876%27 HTTP/1.1" 200 None
2026-03-27 20:32:12 [auto1.be] INFO: Scrape type for WV71876: 2
2026-03-27 20:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fec87cd4-ec68-5ba9-8290-c7871b90b6a3 with identifier: WV71876
2026-03-27 20:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fec87cd4-ec68-5ba9-8290-c7871b90b6a3 with scrape type 2
2026-03-27 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fec87cd4-ec68-5ba9-8290-c7871b90b6a3 with scrape type 2
2026-03-27 20:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fec87cd4-ec68-5ba9-8290-c7871b90b6a3, identifier: WV71876
2026-03-27 20:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fec87cd4-ec68-5ba9-8290-c7871b90b6a3 with identifier: WV71876
2026-03-27 20:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fec87cd4-ec68-5ba9-8290-c7871b90b6a3 with identifier: WV71876
2026-03-27 20:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fec87cd4-ec68-5ba9-8290-c7871b90b6a3 with identifier: WV71876 to the API
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:24:16Z',
 'fuel_type': 'diesel',
 'id': 'fec87cd4-ec68-5ba9-8290-c7871b90b6a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV71876',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 249585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Confortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Confortline BlueMotion',
 'year': 2014}
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV71876%27 HTTP/1.1" 200 None
2026-03-27 20:32:12 [auto1.be] INFO: Saving data for WV71876: {'auction_closing_time': 1774715056.0, 'created_time': 1773135793.416641, 'last_price_update_time': 1774643532.428952}
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV71876') HTTP/1.1" 204 0
2026-03-27 20:32:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: SX01610
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX01610%27 HTTP/1.1" 200 None
2026-03-27 20:32:12 [auto1.be] INFO: Scrape type for SX01610: 0
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: FR59063
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: BZ82774
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: RR37378
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR37378%27 HTTP/1.1" 200 None
2026-03-27 20:32:12 [auto1.be] INFO: Scrape type for RR37378: 0
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: UT85674
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT85674%27 HTTP/1.1" 200 None
2026-03-27 20:32:12 [auto1.be] INFO: Scrape type for UT85674: 0
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: KS18318
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: MZ55081
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ55081%27 HTTP/1.1" 200 None
2026-03-27 20:32:12 [auto1.be] INFO: Scrape type for MZ55081: 0
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: MW21160
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: FK67306
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: ET32561
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET32561%27 HTTP/1.1" 200 None
2026-03-27 20:32:12 [auto1.be] INFO: Scrape type for ET32561: 0
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: KE17510
2026-03-27 20:32:12 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-27 20:32:12 [auto1.be] INFO: Scrape type for DH21315: 2
2026-03-27 20:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315
2026-03-27 20:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eeef821-e9b6-5408-9795-db3f0b0a6098 with scrape type 2
2026-03-27 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eeef821-e9b6-5408-9795-db3f0b0a6098 with scrape type 2
2026-03-27 20:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2eeef821-e9b6-5408-9795-db3f0b0a6098, identifier: DH21315
2026-03-27 20:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315
2026-03-27 20:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315
2026-03-27 20:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315 to the API
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:38:04Z',
 'fuel_type': 'hybrid',
 'id': '2eeef821-e9b6-5408-9795-db3f0b0a6098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH21315',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 70634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-13',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid Longitude',
 'transmission': 'automatic',
 'trim': 'Longitude',
 'year': 2022}
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-27 20:32:12 [auto1.be] INFO: Saving data for DH21315: {'auction_closing_time': 1774715884.0, 'created_time': 1774557104.067219, 'last_price_update_time': 1774643532.95223}
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH21315') HTTP/1.1" 204 0
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-27 20:32:13 [auto1.be] INFO: Scrape type for TV92859: 0
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-27 20:32:13 [auto1.be] INFO: Scrape type for CS46585: 0
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS12124%27 HTTP/1.1" 200 None
2026-03-27 20:32:13 [auto1.be] INFO: Scrape type for TS12124: 0
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: CM71971
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM71971%27 HTTP/1.1" 200 None
2026-03-27 20:32:13 [auto1.be] INFO: Scrape type for CM71971: 0
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-27 20:32:13 [auto1.be] INFO: Scrape type for DY95002: 0
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-27 20:32:13 [auto1.be] INFO: Scrape type for CH34151: 0
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: VY13057
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY13057%27 HTTP/1.1" 200 None
2026-03-27 20:32:13 [auto1.be] INFO: Scrape type for VY13057: 0
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: FG30090
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG30090%27 HTTP/1.1" 200 None
2026-03-27 20:32:13 [auto1.be] INFO: Scrape type for FG30090: 0
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-27 20:32:13 [auto1.be] INFO: Scrape type for MK11042: 0
2026-03-27 20:32:13 [auto1.be] INFO: Found listing with ID: WS17719
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS17719%27 HTTP/1.1" 200 None
2026-03-27 20:32:13 [auto1.be] INFO: Scrape type for WS17719: 2
2026-03-27 20:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be85fc36-ff01-5549-901e-566c0be3acee with identifier: WS17719
2026-03-27 20:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be85fc36-ff01-5549-901e-566c0be3acee with scrape type 2
2026-03-27 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be85fc36-ff01-5549-901e-566c0be3acee with scrape type 2
2026-03-27 20:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: be85fc36-ff01-5549-901e-566c0be3acee, identifier: WS17719
2026-03-27 20:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: be85fc36-ff01-5549-901e-566c0be3acee with identifier: WS17719
2026-03-27 20:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: be85fc36-ff01-5549-901e-566c0be3acee with identifier: WS17719
2026-03-27 20:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: be85fc36-ff01-5549-901e-566c0be3acee with identifier: WS17719 to the API
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-28T16:34:12Z',
 'fuel_type': 'hybrid',
 'id': 'be85fc36-ff01-5549-901e-566c0be3acee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS17719',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 78451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-13',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Plug-in Hybrid High Tech",
 'transmission': 'automatic',
 'trim': 'High Tech',
 'year': 2023}
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS17719%27 HTTP/1.1" 200 None
2026-03-27 20:32:14 [auto1.be] INFO: Saving data for WS17719: {'auction_closing_time': 1774715652.0, 'created_time': 1774438246.463443, 'last_price_update_time': 1774643534.050156}
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WS17719') HTTP/1.1" 204 0
2026-03-27 20:32:14 [auto1.be] INFO: Found listing with ID: PD86825
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD86825%27 HTTP/1.1" 200 None
2026-03-27 20:32:14 [auto1.be] INFO: Scrape type for PD86825: 0
2026-03-27 20:32:14 [auto1.be] INFO: Found listing with ID: MJ84457
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ84457%27 HTTP/1.1" 200 None
2026-03-27 20:32:14 [auto1.be] INFO: Scrape type for MJ84457: 0
2026-03-27 20:32:14 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-27 20:32:14 [auto1.be] INFO: Found listing with ID: AP97194
2026-03-27 20:32:14 [auto1.be] INFO: Found listing with ID: LT43988
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT43988%27 HTTP/1.1" 200 None
2026-03-27 20:32:14 [auto1.be] INFO: Scrape type for LT43988: 2
2026-03-27 20:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7dcf8c7-84ee-5bcc-a0a4-059526d72e69 with identifier: LT43988
2026-03-27 20:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7dcf8c7-84ee-5bcc-a0a4-059526d72e69 with scrape type 2
2026-03-27 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7dcf8c7-84ee-5bcc-a0a4-059526d72e69 with scrape type 2
2026-03-27 20:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c7dcf8c7-84ee-5bcc-a0a4-059526d72e69, identifier: LT43988
2026-03-27 20:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c7dcf8c7-84ee-5bcc-a0a4-059526d72e69 with identifier: LT43988
2026-03-27 20:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c7dcf8c7-84ee-5bcc-a0a4-059526d72e69 with identifier: LT43988
2026-03-27 20:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c7dcf8c7-84ee-5bcc-a0a4-059526d72e69 with identifier: LT43988 to the API
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:00:38Z',
 'fuel_type': 'diesel',
 'id': 'c7dcf8c7-84ee-5bcc-a0a4-059526d72e69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT43988',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 140525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT43988%27 HTTP/1.1" 200 None
2026-03-27 20:32:14 [auto1.be] INFO: Saving data for LT43988: {'auction_closing_time': 1774713638.0, 'created_time': 1774438304.856935, 'last_price_update_time': 1774643534.786716}
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LT43988') HTTP/1.1" 204 0
2026-03-27 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:15 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1659 | hits on page: 40
2026-03-27 20:32:15 [auto1.be] INFO: Found listing with ID: TP87063
2026-03-27 20:32:15 [auto1.be] INFO: Found listing with ID: GV95180
2026-03-27 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV95180%27 HTTP/1.1" 200 None
2026-03-27 20:32:15 [auto1.be] INFO: Scrape type for GV95180: 0
2026-03-27 20:32:15 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-27 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY90857%27 HTTP/1.1" 200 None
2026-03-27 20:32:15 [auto1.be] INFO: Scrape type for DY90857: 2
2026-03-27 20:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd40123f-beeb-55c8-96fe-12ae2d68305e with identifier: DY90857
2026-03-27 20:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd40123f-beeb-55c8-96fe-12ae2d68305e with scrape type 2
2026-03-27 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd40123f-beeb-55c8-96fe-12ae2d68305e with scrape type 2
2026-03-27 20:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd40123f-beeb-55c8-96fe-12ae2d68305e, identifier: DY90857
2026-03-27 20:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd40123f-beeb-55c8-96fe-12ae2d68305e with identifier: DY90857
2026-03-27 20:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd40123f-beeb-55c8-96fe-12ae2d68305e with identifier: DY90857
2026-03-27 20:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd40123f-beeb-55c8-96fe-12ae2d68305e with identifier: DY90857 to the API
2026-03-27 20:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:14:11Z',
 'fuel_type': 'diesel',
 'id': 'cd40123f-beeb-55c8-96fe-12ae2d68305e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY90857',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 219477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY90857%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Saving data for DY90857: {'auction_closing_time': 1774714451.0, 'created_time': 1773135356.109271, 'last_price_update_time': 1774643536.073446}
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY90857') HTTP/1.1" 204 0
2026-03-27 20:32:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: BF21618
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF21618%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for BF21618: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: JL40552
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL40372%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for EL40372: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC05502%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for ZC05502: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: NA79982
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA79982%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for NA79982: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: AB89489
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: CA12532
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA12532%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for CA12532: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for JF41683: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for SE23508: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for FR80699: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for YS56392: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: AF35218
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: WG25655
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: MG71639
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG71639%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for MG71639: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: XC37877
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC37877%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for XC37877: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: XT74022
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: BR44079
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: KN27020
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: KP60973
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP60973%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for KP60973: 0
2026-03-27 20:32:16 [auto1.be] INFO: Found listing with ID: NK66135
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK66135%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Scrape type for NK66135: 2
2026-03-27 20:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c7af6fa-12de-5c70-95e2-fc93cb2c2ebd with identifier: NK66135
2026-03-27 20:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c7af6fa-12de-5c70-95e2-fc93cb2c2ebd with scrape type 2
2026-03-27 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c7af6fa-12de-5c70-95e2-fc93cb2c2ebd with scrape type 2
2026-03-27 20:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c7af6fa-12de-5c70-95e2-fc93cb2c2ebd, identifier: NK66135
2026-03-27 20:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c7af6fa-12de-5c70-95e2-fc93cb2c2ebd with identifier: NK66135
2026-03-27 20:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c7af6fa-12de-5c70-95e2-fc93cb2c2ebd with identifier: NK66135
2026-03-27 20:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c7af6fa-12de-5c70-95e2-fc93cb2c2ebd with identifier: NK66135 to the API
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:55:36Z',
 'fuel_type': 'petrol',
 'id': '1c7af6fa-12de-5c70-95e2-fc93cb2c2ebd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK66135',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 134034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-19',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK66135%27 HTTP/1.1" 200 None
2026-03-27 20:32:16 [auto1.be] INFO: Saving data for NK66135: {'auction_closing_time': 1774716936.0, 'created_time': 1774438283.434035, 'last_price_update_time': 1774643536.956607}
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NK66135') HTTP/1.1" 204 0
2026-03-27 20:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP16725/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:17 [auto1.be] INFO: Found listing with ID: JY55711
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY55711%27 HTTP/1.1" 200 None
2026-03-27 20:32:17 [auto1.be] INFO: Scrape type for JY55711: 0
2026-03-27 20:32:17 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-27 20:32:17 [auto1.be] INFO: Scrape type for BK01349: 0
2026-03-27 20:32:17 [auto1.be] INFO: Found listing with ID: NP40379
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP40379%27 HTTP/1.1" 200 None
2026-03-27 20:32:17 [auto1.be] INFO: Scrape type for NP40379: 2
2026-03-27 20:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beae2ed0-cdec-507a-9a81-d235f53845df with identifier: NP40379
2026-03-27 20:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beae2ed0-cdec-507a-9a81-d235f53845df with scrape type 2
2026-03-27 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beae2ed0-cdec-507a-9a81-d235f53845df with scrape type 2
2026-03-27 20:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: beae2ed0-cdec-507a-9a81-d235f53845df, identifier: NP40379
2026-03-27 20:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: beae2ed0-cdec-507a-9a81-d235f53845df with identifier: NP40379
2026-03-27 20:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: beae2ed0-cdec-507a-9a81-d235f53845df with identifier: NP40379
2026-03-27 20:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: beae2ed0-cdec-507a-9a81-d235f53845df with identifier: NP40379 to the API
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:00Z',
 'fuel_type': 'petrol',
 'id': 'beae2ed0-cdec-507a-9a81-d235f53845df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP40379',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 162341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-24',
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 TGDi Longitude 4x2',
 'transmission': 'automatic',
 'trim': 'Longitude 4x2',
 'year': 2020}
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP40379%27 HTTP/1.1" 200 None
2026-03-27 20:32:17 [auto1.be] INFO: Saving data for NP40379: {'auction_closing_time': 1774714560.0, 'created_time': 1773301685.667549, 'last_price_update_time': 1774643537.52357}
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP40379') HTTP/1.1" 204 0
2026-03-27 20:32:17 [auto1.be] INFO: Found listing with ID: RX78624
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX78624%27 HTTP/1.1" 200 None
2026-03-27 20:32:17 [auto1.be] INFO: Scrape type for RX78624: 2
2026-03-27 20:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cc6d0e5-eafe-58a0-af44-75a4472e2e0e with identifier: RX78624
2026-03-27 20:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cc6d0e5-eafe-58a0-af44-75a4472e2e0e with scrape type 2
2026-03-27 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cc6d0e5-eafe-58a0-af44-75a4472e2e0e with scrape type 2
2026-03-27 20:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7cc6d0e5-eafe-58a0-af44-75a4472e2e0e, identifier: RX78624
2026-03-27 20:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7cc6d0e5-eafe-58a0-af44-75a4472e2e0e with identifier: RX78624
2026-03-27 20:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7cc6d0e5-eafe-58a0-af44-75a4472e2e0e with identifier: RX78624
2026-03-27 20:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7cc6d0e5-eafe-58a0-af44-75a4472e2e0e with identifier: RX78624 to the API
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:47:51Z',
 'fuel_type': 'petrol',
 'id': '7cc6d0e5-eafe-58a0-af44-75a4472e2e0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX78624',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 171283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-02',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX78624%27 HTTP/1.1" 200 None
2026-03-27 20:32:17 [auto1.be] INFO: Saving data for RX78624: {'auction_closing_time': 1774716471.0, 'created_time': 1774438263.846136, 'last_price_update_time': 1774643537.987912}
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX78624') HTTP/1.1" 204 0
2026-03-27 20:32:18 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-27 20:32:18 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-27 20:32:18 [auto1.be] INFO: Scrape type for RK82839: 2
2026-03-27 20:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839
2026-03-27 20:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff44973-eac5-5cf4-8615-308de1b32056 with scrape type 2
2026-03-27 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ff44973-eac5-5cf4-8615-308de1b32056 with scrape type 2
2026-03-27 20:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1ff44973-eac5-5cf4-8615-308de1b32056, identifier: RK82839
2026-03-27 20:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839
2026-03-27 20:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839
2026-03-27 20:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839 to the API
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:02:47Z',
 'fuel_type': 'diesel',
 'id': '1ff44973-eac5-5cf4-8615-308de1b32056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK82839',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 253653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-27 20:32:18 [auto1.be] INFO: Saving data for RK82839: {'auction_closing_time': 1774713767.0, 'created_time': 1774557030.721367, 'last_price_update_time': 1774643538.382405}
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK82839') HTTP/1.1" 204 0
2026-03-27 20:32:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:18 [auto1.be] INFO: Found listing with ID: AC35394
2026-03-27 20:32:18 [auto1.be] INFO: Found listing with ID: JX10335
2026-03-27 20:32:18 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-27 20:32:18 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-27 20:32:18 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-27 20:32:18 [auto1.be] INFO: Scrape type for MN41841: 0
2026-03-27 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:19 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1659 | hits on page: 40
2026-03-27 20:32:19 [auto1.be] INFO: Found listing with ID: HM70865
2026-03-27 20:32:19 [auto1.be] INFO: Found listing with ID: RR60731
2026-03-27 20:32:19 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-27 20:32:19 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-27 20:32:19 [auto1.be] INFO: Scrape type for KM93600: 2
2026-03-27 20:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600
2026-03-27 20:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70ba890e-ae1d-5456-868e-0a257b86508f with scrape type 2
2026-03-27 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70ba890e-ae1d-5456-868e-0a257b86508f with scrape type 2
2026-03-27 20:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70ba890e-ae1d-5456-868e-0a257b86508f, identifier: KM93600
2026-03-27 20:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600
2026-03-27 20:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600
2026-03-27 20:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600 to the API
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:26:15Z',
 'fuel_type': 'petrol',
 'id': '70ba890e-ae1d-5456-868e-0a257b86508f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM93600',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 244431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-15',
 'seller_name': None,
 'title': 'Dacia Logan MCV 0.9 TCe Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2014}
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-27 20:32:19 [auto1.be] INFO: Saving data for KM93600: {'auction_closing_time': 1774715175.0, 'created_time': 1774125092.705644, 'last_price_update_time': 1774643539.630968}
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM93600') HTTP/1.1" 204 0
2026-03-27 20:32:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:19 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-27 20:32:19 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH79590%27 HTTP/1.1" 200 None
2026-03-27 20:32:19 [auto1.be] INFO: Scrape type for DH79590: 0
2026-03-27 20:32:19 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-27 20:32:19 [auto1.be] INFO: Found listing with ID: SD12606
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD12606%27 HTTP/1.1" 200 None
2026-03-27 20:32:19 [auto1.be] INFO: Scrape type for SD12606: 1
2026-03-27 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP16725> (referer: https://www.auto1.com/v1/car-details-view/KP16725/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:19 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-27 20:32:19 [auto1.be] INFO: Scrape type for WP21428: 0
2026-03-27 20:32:19 [auto1.be] INFO: Found listing with ID: NZ68355
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ68355%27 HTTP/1.1" 200 None
2026-03-27 20:32:19 [auto1.be] INFO: Scrape type for NZ68355: 0
2026-03-27 20:32:19 [auto1.be] INFO: Found listing with ID: EM34677
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM34677%27 HTTP/1.1" 200 None
2026-03-27 20:32:19 [auto1.be] INFO: Scrape type for EM34677: 2
2026-03-27 20:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4f14a27-e96c-5b22-83c3-287434ff7ba0 with identifier: EM34677
2026-03-27 20:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4f14a27-e96c-5b22-83c3-287434ff7ba0 with scrape type 2
2026-03-27 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4f14a27-e96c-5b22-83c3-287434ff7ba0 with scrape type 2
2026-03-27 20:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4f14a27-e96c-5b22-83c3-287434ff7ba0, identifier: EM34677
2026-03-27 20:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4f14a27-e96c-5b22-83c3-287434ff7ba0 with identifier: EM34677
2026-03-27 20:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4f14a27-e96c-5b22-83c3-287434ff7ba0 with identifier: EM34677
2026-03-27 20:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4f14a27-e96c-5b22-83c3-287434ff7ba0 with identifier: EM34677 to the API
2026-03-27 20:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:59Z',
 'fuel_type': 'diesel',
 'id': 'b4f14a27-e96c-5b22-83c3-287434ff7ba0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM34677',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 191353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-19',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Attractive',
 'transmission': 'manual',
 'trim': 'Attractive',
 'year': 2011}
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM34677%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [auto1.be] INFO: Saving data for EM34677: {'auction_closing_time': 1774714739.0, 'created_time': 1774438268.120694, 'last_price_update_time': 1774643540.16842}
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EM34677') HTTP/1.1" 204 0
2026-03-27 20:32:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: MR16317
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: CP38880
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: VW93174
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: SW05863
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW05863%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [auto1.be] INFO: Scrape type for SW05863: 0
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: ZB89914
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: EW28397
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW28397%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [auto1.be] INFO: Scrape type for EW28397: 0
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: CZ35254
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ35254%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [auto1.be] INFO: Scrape type for CZ35254: 0
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [auto1.be] INFO: Scrape type for XU40393: 2
2026-03-27 20:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393
2026-03-27 20:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac89b154-77ed-54a0-ad45-c771c34bd66c with scrape type 2
2026-03-27 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac89b154-77ed-54a0-ad45-c771c34bd66c with scrape type 2
2026-03-27 20:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ac89b154-77ed-54a0-ad45-c771c34bd66c, identifier: XU40393
2026-03-27 20:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393
2026-03-27 20:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393
2026-03-27 20:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393 to the API
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:48Z',
 'fuel_type': 'petrol',
 'id': 'ac89b154-77ed-54a0-ad45-c771c34bd66c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU40393',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 83337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2020}
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [auto1.be] INFO: Saving data for XU40393: {'auction_closing_time': 1774717008.0, 'created_time': 1774298144.853249, 'last_price_update_time': 1774643540.630944}
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XU40393') HTTP/1.1" 204 0
2026-03-27 20:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725
2026-03-27 20:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with scrape type 1
2026-03-27 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_e76db4a48716d9ec7621dfe054d6c4ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e76db4a48716d9ec7621dfe054d6c4ff.jpg not downloaded yet
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: RS16246
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16246%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [auto1.be] INFO: Scrape type for RS16246: 0
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: DK36221
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK36221%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [auto1.be] INFO: Scrape type for DK36221: 0
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: ZC75548
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW36552%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [auto1.be] INFO: Scrape type for CW36552: 0
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: FJ85398
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: CB02189
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: EN96756
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN96756%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [auto1.be] INFO: Scrape type for EN96756: 0
2026-03-27 20:32:20 [auto1.be] INFO: Found listing with ID: RG16696
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG16696%27 HTTP/1.1" 200 None
2026-03-27 20:32:20 [auto1.be] INFO: Scrape type for RG16696: 2
2026-03-27 20:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1d2fbb-0baa-5e9f-8479-af34760a2ee1 with identifier: RG16696
2026-03-27 20:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1d2fbb-0baa-5e9f-8479-af34760a2ee1 with scrape type 2
2026-03-27 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1d2fbb-0baa-5e9f-8479-af34760a2ee1 with scrape type 2
2026-03-27 20:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a1d2fbb-0baa-5e9f-8479-af34760a2ee1, identifier: RG16696
2026-03-27 20:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a1d2fbb-0baa-5e9f-8479-af34760a2ee1 with identifier: RG16696
2026-03-27 20:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a1d2fbb-0baa-5e9f-8479-af34760a2ee1 with identifier: RG16696
2026-03-27 20:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a1d2fbb-0baa-5e9f-8479-af34760a2ee1 with identifier: RG16696 to the API
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:26:21Z',
 'fuel_type': 'petrol',
 'id': '5a1d2fbb-0baa-5e9f-8479-af34760a2ee1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG16696',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 104765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-12',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2008}
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG16696%27 HTTP/1.1" 200 None
2026-03-27 20:32:21 [auto1.be] INFO: Saving data for RG16696: {'auction_closing_time': 1774715181.0, 'created_time': 1774438259.005899, 'last_price_update_time': 1774643541.260198}
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RG16696') HTTP/1.1" 204 0
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_27a7f76b64bb49edc584b4c05ed723b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_27a7f76b64bb49edc584b4c05ed723b1.jpg not downloaded yet
2026-03-27 20:32:21 [auto1.be] INFO: Found listing with ID: PC39555
2026-03-27 20:32:21 [auto1.be] INFO: Found listing with ID: FD01860
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD01860%27 HTTP/1.1" 200 None
2026-03-27 20:32:21 [auto1.be] INFO: Scrape type for FD01860: 2
2026-03-27 20:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 125ee0cf-89c3-51c3-9f23-0e84a7c53fe8 with identifier: FD01860
2026-03-27 20:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 125ee0cf-89c3-51c3-9f23-0e84a7c53fe8 with scrape type 2
2026-03-27 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 125ee0cf-89c3-51c3-9f23-0e84a7c53fe8 with scrape type 2
2026-03-27 20:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 125ee0cf-89c3-51c3-9f23-0e84a7c53fe8, identifier: FD01860
2026-03-27 20:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 125ee0cf-89c3-51c3-9f23-0e84a7c53fe8 with identifier: FD01860
2026-03-27 20:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 125ee0cf-89c3-51c3-9f23-0e84a7c53fe8 with identifier: FD01860
2026-03-27 20:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 125ee0cf-89c3-51c3-9f23-0e84a7c53fe8 with identifier: FD01860 to the API
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:27Z',
 'fuel_type': 'diesel',
 'id': '125ee0cf-89c3-51c3-9f23-0e84a7c53fe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD01860',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 302134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD01860%27 HTTP/1.1" 200 None
2026-03-27 20:32:21 [auto1.be] INFO: Saving data for FD01860: {'auction_closing_time': 1774715187.0, 'created_time': 1773133418.464458, 'last_price_update_time': 1774643541.66697}
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FD01860') HTTP/1.1" 204 0
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_c8a0f02724982f1d388cdea4a1460ac7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_c8a0f02724982f1d388cdea4a1460ac7.jpg not downloaded yet
2026-03-27 20:32:21 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-27 20:32:21 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE06051%27 HTTP/1.1" 200 None
2026-03-27 20:32:21 [auto1.be] INFO: Scrape type for PE06051: 2
2026-03-27 20:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with identifier: PE06051
2026-03-27 20:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with scrape type 2
2026-03-27 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with scrape type 2
2026-03-27 20:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 52c4748a-0e47-5ed3-a287-86ef18ff7d41, identifier: PE06051
2026-03-27 20:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with identifier: PE06051
2026-03-27 20:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with identifier: PE06051
2026-03-27 20:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with identifier: PE06051 to the API
2026-03-27 20:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:28:15Z',
 'fuel_type': 'petrol',
 'id': '52c4748a-0e47-5ed3-a287-86ef18ff7d41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE06051',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 101121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-28',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2009}
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE06051%27 HTTP/1.1" 200 None
2026-03-27 20:32:22 [auto1.be] INFO: Saving data for PE06051: {'auction_closing_time': 1774715295.0, 'created_time': 1773133170.652912, 'last_price_update_time': 1774643542.138168}
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PE06051') HTTP/1.1" 204 0
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_861a3afd204bed17eaec73657c0b2b92.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_861a3afd204bed17eaec73657c0b2b92.jpg not downloaded yet
2026-03-27 20:32:22 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-27 20:32:22 [auto1.be] INFO: Found listing with ID: XN84271
2026-03-27 20:32:22 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-27 20:32:22 [auto1.be] INFO: Scrape type for PH78267: 0
2026-03-27 20:32:22 [auto1.be] INFO: Found listing with ID: HW03040
2026-03-27 20:32:22 [auto1.be] INFO: Found listing with ID: YS23980
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS23980%27 HTTP/1.1" 200 None
2026-03-27 20:32:22 [auto1.be] INFO: Scrape type for YS23980: 2
2026-03-27 20:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03cca390-e6c2-5e37-b2c4-733df15b7862 with identifier: YS23980
2026-03-27 20:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03cca390-e6c2-5e37-b2c4-733df15b7862 with scrape type 2
2026-03-27 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03cca390-e6c2-5e37-b2c4-733df15b7862 with scrape type 2
2026-03-27 20:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 03cca390-e6c2-5e37-b2c4-733df15b7862, identifier: YS23980
2026-03-27 20:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 03cca390-e6c2-5e37-b2c4-733df15b7862 with identifier: YS23980
2026-03-27 20:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 03cca390-e6c2-5e37-b2c4-733df15b7862 with identifier: YS23980
2026-03-27 20:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 03cca390-e6c2-5e37-b2c4-733df15b7862 with identifier: YS23980 to the API
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:07:01Z',
 'fuel_type': 'petrol',
 'id': '03cca390-e6c2-5e37-b2c4-733df15b7862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS23980',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 37279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-16',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 170 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2008}
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS23980%27 HTTP/1.1" 200 None
2026-03-27 20:32:22 [auto1.be] INFO: Saving data for YS23980: {'auction_closing_time': 1774714021.0, 'created_time': 1774438295.127668, 'last_price_update_time': 1774643542.553263}
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS23980') HTTP/1.1" 204 0
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_f1e41b8bb6da184fd420ddcbaa3c77ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_f1e41b8bb6da184fd420ddcbaa3c77ed.jpg not downloaded yet
2026-03-27 20:32:22 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_ed83dc677722e06b9e62a2a64816e01f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_ed83dc677722e06b9e62a2a64816e01f.jpg not downloaded yet
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_ec054877ee769add088d1a30006fe1c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_ec054877ee769add088d1a30006fe1c3.jpg not downloaded yet
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_e547669420141ffbd50e01b4260a77e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e547669420141ffbd50e01b4260a77e2.jpg not downloaded yet
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_e180d39640baf260c594b26bf2b9edd3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e180d39640baf260c594b26bf2b9edd3.jpg not downloaded yet
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_343d7a20caaab9039b8865c9672ff77e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_343d7a20caaab9039b8865c9672ff77e.jpg not downloaded yet
2026-03-27 20:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e76db4a48716d9ec7621dfe054d6c4ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_c8a0f02724982f1d388cdea4a1460ac7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_27a7f76b64bb49edc584b4c05ed723b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_ed83dc677722e06b9e62a2a64816e01f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:32:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353684c90>
2026-03-27 20:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_e76db4a48716d9ec7621dfe054d6c4ff.jpg') HTTP/1.1" 204 0
2026-03-27 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e76db4a48716d9ec7621dfe054d6c4ff.jpg saved to cache
2026-03-27 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555
2026-03-27 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a11dd0>
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_c8a0f02724982f1d388cdea4a1460ac7.jpg') HTTP/1.1" 204 0
2026-03-27 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_c8a0f02724982f1d388cdea4a1460ac7.jpg saved to cache
2026-03-27 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555
2026-03-27 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35340c950>
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_27a7f76b64bb49edc584b4c05ed723b1.jpg') HTTP/1.1" 204 0
2026-03-27 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_27a7f76b64bb49edc584b4c05ed723b1.jpg saved to cache
2026-03-27 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555
2026-03-27 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e547669420141ffbd50e01b4260a77e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD12606/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35a45da50>
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_ed83dc677722e06b9e62a2a64816e01f.jpg') HTTP/1.1" 204 0
2026-03-27 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_ed83dc677722e06b9e62a2a64816e01f.jpg saved to cache
2026-03-27 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35951e2d0>
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_e547669420141ffbd50e01b4260a77e2.jpg') HTTP/1.1" 204 0
2026-03-27 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e547669420141ffbd50e01b4260a77e2.jpg saved to cache
2026-03-27 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555
2026-03-27 20:32:23 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1659 | hits on page: 40
2026-03-27 20:32:23 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-27 20:32:23 [auto1.be] INFO: Found listing with ID: FB63888
2026-03-27 20:32:23 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU19738%27 HTTP/1.1" 200 None
2026-03-27 20:32:23 [auto1.be] INFO: Scrape type for SU19738: 0
2026-03-27 20:32:23 [auto1.be] INFO: Found listing with ID: XN65088
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN65088%27 HTTP/1.1" 200 None
2026-03-27 20:32:23 [auto1.be] INFO: Scrape type for XN65088: 1
2026-03-27 20:32:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:23 [auto1.be] INFO: Found listing with ID: YH93162
2026-03-27 20:32:23 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-27 20:32:23 [auto1.be] INFO: Found listing with ID: MB61651
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB61651%27 HTTP/1.1" 200 None
2026-03-27 20:32:23 [auto1.be] INFO: Scrape type for MB61651: 1
2026-03-27 20:32:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_ec054877ee769add088d1a30006fe1c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:32:23 [auto1.be] INFO: Found listing with ID: JL90308
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL90308%27 HTTP/1.1" 200 None
2026-03-27 20:32:23 [auto1.be] INFO: Scrape type for JL90308: 0
2026-03-27 20:32:23 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-27 20:32:23 [auto1.be] INFO: Scrape type for ZC87174: 2
2026-03-27 20:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174
2026-03-27 20:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with scrape type 2
2026-03-27 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with scrape type 2
2026-03-27 20:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4, identifier: ZC87174
2026-03-27 20:32:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-27 20:32:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174
2026-03-27 20:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174 to the API
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:49:03Z',
 'fuel_type': 'diesel',
 'id': '1da2ecfb-0357-5a49-a64a-3f5fff6d28b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC87174',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 199523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-22',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.9 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2010}
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-27 20:32:24 [auto1.be] INFO: Saving data for ZC87174: {'auction_closing_time': 1774716543.0, 'created_time': 1773301759.801402, 'last_price_update_time': 1774643544.225802}
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC87174') HTTP/1.1" 204 0
2026-03-27 20:32:24 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-27 20:32:24 [auto1.be] INFO: Scrape type for TR87241: 0
2026-03-27 20:32:24 [auto1.be] INFO: Found listing with ID: GX95713
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX95713%27 HTTP/1.1" 200 None
2026-03-27 20:32:24 [auto1.be] INFO: Scrape type for GX95713: 0
2026-03-27 20:32:24 [auto1.be] INFO: Found listing with ID: HE27589
2026-03-27 20:32:24 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-27 20:32:24 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-27 20:32:24 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-27 20:32:24 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-27 20:32:24 [auto1.be] INFO: Scrape type for VP73114: 2
2026-03-27 20:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114
2026-03-27 20:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c332e4-ce8d-57bf-9435-f66638edd52e with scrape type 2
2026-03-27 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39c332e4-ce8d-57bf-9435-f66638edd52e with scrape type 2
2026-03-27 20:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 39c332e4-ce8d-57bf-9435-f66638edd52e, identifier: VP73114
2026-03-27 20:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114
2026-03-27 20:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114
2026-03-27 20:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114 to the API
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:17:00Z',
 'fuel_type': 'diesel',
 'id': '39c332e4-ce8d-57bf-9435-f66638edd52e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP73114',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 403007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-10',
 'seller_name': None,
 'title': 'Toyota Avensis 2.0 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-27 20:32:24 [auto1.be] INFO: Saving data for VP73114: {'auction_closing_time': 1774714620.0, 'created_time': 1774125108.714113, 'last_price_update_time': 1774643544.739076}
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP73114') HTTP/1.1" 204 0
2026-03-27 20:32:24 [auto1.be] INFO: Found listing with ID: TC02969
2026-03-27 20:32:24 [auto1.be] INFO: Found listing with ID: MA95611
2026-03-27 20:32:24 [auto1.be] INFO: Found listing with ID: YN67239
2026-03-27 20:32:24 [auto1.be] INFO: Found listing with ID: PF50688
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF50688%27 HTTP/1.1" 200 None
2026-03-27 20:32:24 [auto1.be] INFO: Scrape type for PF50688: 2
2026-03-27 20:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c26122c3-ca81-5ce3-8597-f1224c04b5a6 with identifier: PF50688
2026-03-27 20:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26122c3-ca81-5ce3-8597-f1224c04b5a6 with scrape type 2
2026-03-27 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c26122c3-ca81-5ce3-8597-f1224c04b5a6 with scrape type 2
2026-03-27 20:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c26122c3-ca81-5ce3-8597-f1224c04b5a6, identifier: PF50688
2026-03-27 20:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c26122c3-ca81-5ce3-8597-f1224c04b5a6 with identifier: PF50688
2026-03-27 20:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c26122c3-ca81-5ce3-8597-f1224c04b5a6 with identifier: PF50688
2026-03-27 20:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c26122c3-ca81-5ce3-8597-f1224c04b5a6 with identifier: PF50688 to the API
2026-03-27 20:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:43Z',
 'fuel_type': 'petrol',
 'id': 'c26122c3-ca81-5ce3-8597-f1224c04b5a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF50688',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 182980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-13',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF50688%27 HTTP/1.1" 200 None
2026-03-27 20:32:25 [auto1.be] INFO: Saving data for PF50688: {'auction_closing_time': 1774714963.0, 'created_time': 1774438246.928253, 'last_price_update_time': 1774643545.139192}
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PF50688') HTTP/1.1" 204 0
2026-03-27 20:32:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a134d0>
2026-03-27 20:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_ec054877ee769add088d1a30006fe1c3.jpg') HTTP/1.1" 204 0
2026-03-27 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_ec054877ee769add088d1a30006fe1c3.jpg saved to cache
2026-03-27 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555
2026-03-27 20:32:25 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-27 20:32:25 [auto1.be] INFO: Scrape type for UF75491: 2
2026-03-27 20:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491
2026-03-27 20:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31d5c763-c727-54ba-a535-c23725c647f6 with scrape type 2
2026-03-27 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31d5c763-c727-54ba-a535-c23725c647f6 with scrape type 2
2026-03-27 20:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31d5c763-c727-54ba-a535-c23725c647f6, identifier: UF75491
2026-03-27 20:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491
2026-03-27 20:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491
2026-03-27 20:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491 to the API
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:27:29Z',
 'fuel_type': 'diesel',
 'id': '31d5c763-c727-54ba-a535-c23725c647f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF75491',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 212924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-23',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-27 20:32:25 [auto1.be] INFO: Saving data for UF75491: {'auction_closing_time': 1774715249.0, 'created_time': 1773133264.509273, 'last_price_update_time': 1774643545.734463}
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UF75491') HTTP/1.1" 204 0
2026-03-27 20:32:25 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-27 20:32:25 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-27 20:32:25 [auto1.be] INFO: Found listing with ID: RW46644
2026-03-27 20:32:25 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-27 20:32:25 [auto1.be] INFO: Scrape type for UL34611: 2
2026-03-27 20:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611
2026-03-27 20:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e3db12-67b8-50d3-92db-458c0c76c2d8 with scrape type 2
2026-03-27 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5e3db12-67b8-50d3-92db-458c0c76c2d8 with scrape type 2
2026-03-27 20:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5e3db12-67b8-50d3-92db-458c0c76c2d8, identifier: UL34611
2026-03-27 20:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611
2026-03-27 20:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611
2026-03-27 20:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611 to the API
2026-03-27 20:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:52:21Z',
 'fuel_type': 'hybrid',
 'id': 'c5e3db12-67b8-50d3-92db-458c0c76c2d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL34611',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 175078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Recharge Plug-in Hybrid Inscription Expression '
          '2WD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression 2WD',
 'year': 2022}
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-27 20:32:26 [auto1.be] INFO: Saving data for UL34611: {'auction_closing_time': 1774716741.0, 'created_time': 1773301757.745511, 'last_price_update_time': 1774643546.170768}
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UL34611') HTTP/1.1" 204 0
2026-03-27 20:32:26 [auto1.be] INFO: Found listing with ID: KW79847
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW79847%27 HTTP/1.1" 200 None
2026-03-27 20:32:26 [auto1.be] INFO: Scrape type for KW79847: 2
2026-03-27 20:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8f183ae-616a-5263-a33f-d49c56b3183a with identifier: KW79847
2026-03-27 20:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8f183ae-616a-5263-a33f-d49c56b3183a with scrape type 2
2026-03-27 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8f183ae-616a-5263-a33f-d49c56b3183a with scrape type 2
2026-03-27 20:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c8f183ae-616a-5263-a33f-d49c56b3183a, identifier: KW79847
2026-03-27 20:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c8f183ae-616a-5263-a33f-d49c56b3183a with identifier: KW79847
2026-03-27 20:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c8f183ae-616a-5263-a33f-d49c56b3183a with identifier: KW79847
2026-03-27 20:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c8f183ae-616a-5263-a33f-d49c56b3183a with identifier: KW79847 to the API
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:37:07Z',
 'fuel_type': 'diesel',
 'id': 'c8f183ae-616a-5263-a33f-d49c56b3183a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW79847',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 119851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-02',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTD Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2015}
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW79847%27 HTTP/1.1" 200 None
2026-03-27 20:32:26 [auto1.be] INFO: Saving data for KW79847: {'auction_closing_time': 1774715827.0, 'created_time': 1773779958.696768, 'last_price_update_time': 1774643546.654868}
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW79847') HTTP/1.1" 204 0
2026-03-27 20:32:26 [auto1.be] INFO: Found listing with ID: SM94010
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM94010%27 HTTP/1.1" 200 None
2026-03-27 20:32:26 [auto1.be] INFO: Scrape type for SM94010: 0
2026-03-27 20:32:26 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-27 20:32:26 [auto1.be] INFO: Scrape type for SD60477: 0
2026-03-27 20:32:26 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-27 20:32:26 [auto1.be] INFO: Found listing with ID: PS48856
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS48856%27 HTTP/1.1" 200 None
2026-03-27 20:32:26 [auto1.be] INFO: Scrape type for PS48856: 1
2026-03-27 20:32:26 [auto1.be] INFO: Found listing with ID: MS47880
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS47880%27 HTTP/1.1" 200 None
2026-03-27 20:32:26 [auto1.be] INFO: Scrape type for MS47880: 2
2026-03-27 20:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eab5fc83-8d9e-56f4-9595-16f16beadeab with identifier: MS47880
2026-03-27 20:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eab5fc83-8d9e-56f4-9595-16f16beadeab with scrape type 2
2026-03-27 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eab5fc83-8d9e-56f4-9595-16f16beadeab with scrape type 2
2026-03-27 20:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eab5fc83-8d9e-56f4-9595-16f16beadeab, identifier: MS47880
2026-03-27 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB61651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN65088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eab5fc83-8d9e-56f4-9595-16f16beadeab with identifier: MS47880
2026-03-27 20:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eab5fc83-8d9e-56f4-9595-16f16beadeab with identifier: MS47880
2026-03-27 20:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eab5fc83-8d9e-56f4-9595-16f16beadeab with identifier: MS47880 to the API
2026-03-27 20:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:55:43Z',
 'fuel_type': 'petrol',
 'id': 'eab5fc83-8d9e-56f4-9595-16f16beadeab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS47880',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 71390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-26',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2020}
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS47880%27 HTTP/1.1" 200 None
2026-03-27 20:32:27 [auto1.be] INFO: Saving data for MS47880: {'auction_closing_time': 1774716943.0, 'created_time': 1773693384.319911, 'last_price_update_time': 1774643547.156466}
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS47880') HTTP/1.1" 204 0
2026-03-27 20:32:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:27 [auto1.be] INFO: Found listing with ID: LH74784
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH74784%27 HTTP/1.1" 200 None
2026-03-27 20:32:27 [auto1.be] INFO: Scrape type for LH74784: 0
2026-03-27 20:32:27 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD78607%27 HTTP/1.1" 200 None
2026-03-27 20:32:27 [auto1.be] INFO: Scrape type for PD78607: 0
2026-03-27 20:32:27 [auto1.be] INFO: Found listing with ID: NF55706
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF55706%27 HTTP/1.1" 200 None
2026-03-27 20:32:27 [auto1.be] INFO: Scrape type for NF55706: 2
2026-03-27 20:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e68f9a-da64-54d7-9d80-5af47ad94512 with identifier: NF55706
2026-03-27 20:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e68f9a-da64-54d7-9d80-5af47ad94512 with scrape type 2
2026-03-27 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1e68f9a-da64-54d7-9d80-5af47ad94512 with scrape type 2
2026-03-27 20:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b1e68f9a-da64-54d7-9d80-5af47ad94512, identifier: NF55706
2026-03-27 20:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b1e68f9a-da64-54d7-9d80-5af47ad94512 with identifier: NF55706
2026-03-27 20:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b1e68f9a-da64-54d7-9d80-5af47ad94512 with identifier: NF55706
2026-03-27 20:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b1e68f9a-da64-54d7-9d80-5af47ad94512 with identifier: NF55706 to the API
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:19:54Z',
 'fuel_type': 'petrol',
 'id': 'b1e68f9a-da64-54d7-9d80-5af47ad94512',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF55706',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 82894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-06',
 'seller_name': None,
 'title': 'Opel Karl 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2016}
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF55706%27 HTTP/1.1" 200 None
2026-03-27 20:32:27 [auto1.be] INFO: Saving data for NF55706: {'auction_closing_time': 1774714794.0, 'created_time': 1774438227.842861, 'last_price_update_time': 1774643547.698946}
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NF55706') HTTP/1.1" 204 0
2026-03-27 20:32:27 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-27 20:32:27 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-27 20:32:27 [auto1.be] INFO: Scrape type for VA87646: 0
2026-03-27 20:32:27 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-27 20:32:27 [auto1.be] INFO: Found listing with ID: GX65351
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX65351%27 HTTP/1.1" 200 None
2026-03-27 20:32:27 [auto1.be] INFO: Scrape type for GX65351: 2
2026-03-27 20:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99b1c6eb-e021-5488-b00b-4873fbe9b2b5 with identifier: GX65351
2026-03-27 20:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99b1c6eb-e021-5488-b00b-4873fbe9b2b5 with scrape type 2
2026-03-27 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99b1c6eb-e021-5488-b00b-4873fbe9b2b5 with scrape type 2
2026-03-27 20:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 99b1c6eb-e021-5488-b00b-4873fbe9b2b5, identifier: GX65351
2026-03-27 20:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 99b1c6eb-e021-5488-b00b-4873fbe9b2b5 with identifier: GX65351
2026-03-27 20:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 99b1c6eb-e021-5488-b00b-4873fbe9b2b5 with identifier: GX65351
2026-03-27 20:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 99b1c6eb-e021-5488-b00b-4873fbe9b2b5 with identifier: GX65351 to the API
2026-03-27 20:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:28:11Z',
 'fuel_type': 'petrol',
 'id': '99b1c6eb-e021-5488-b00b-4873fbe9b2b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX65351',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 79233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-31',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX65351%27 HTTP/1.1" 200 None
2026-03-27 20:32:28 [auto1.be] INFO: Saving data for GX65351: {'auction_closing_time': 1774715291.0, 'created_time': 1774438300.299837, 'last_price_update_time': 1774643548.109757}
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GX65351') HTTP/1.1" 204 0
2026-03-27 20:32:28 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1659 | hits on page: 40
2026-03-27 20:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_343d7a20caaab9039b8865c9672ff77e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX58483%27 HTTP/1.1" 200 None
2026-03-27 20:32:28 [auto1.be] INFO: Scrape type for ZX58483: 0
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-27 20:32:28 [auto1.be] INFO: Scrape type for ZM46816: 0
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: HS55716
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: KG32291
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG32291%27 HTTP/1.1" 200 None
2026-03-27 20:32:28 [auto1.be] INFO: Scrape type for KG32291: 0
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: UB82847
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-27 20:32:28 [auto1.be] INFO: Scrape type for TS87416: 2
2026-03-27 20:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416
2026-03-27 20:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e85abd7-0d1a-5972-8153-e65223145e48 with scrape type 2
2026-03-27 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e85abd7-0d1a-5972-8153-e65223145e48 with scrape type 2
2026-03-27 20:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e85abd7-0d1a-5972-8153-e65223145e48, identifier: TS87416
2026-03-27 20:32:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416
2026-03-27 20:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416
2026-03-27 20:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416 to the API
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:14:04Z',
 'fuel_type': 'diesel',
 'id': '4e85abd7-0d1a-5972-8153-e65223145e48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS87416',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 167898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-24',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2014}
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-27 20:32:28 [auto1.be] INFO: Saving data for TS87416: {'auction_closing_time': 1774714444.0, 'created_time': 1774557055.560544, 'last_price_update_time': 1774643548.557488}
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS87416') HTTP/1.1" 204 0
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: HR21590
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: WG39475
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG39475%27 HTTP/1.1" 200 None
2026-03-27 20:32:28 [auto1.be] INFO: Scrape type for WG39475: 0
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-27 20:32:28 [auto1.be] INFO: Scrape type for GT11330: 0
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: NE31569
2026-03-27 20:32:28 [auto1.be] INFO: Found listing with ID: CL62340
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CL62340%27 HTTP/1.1" 200 None
2026-03-27 20:32:28 [auto1.be] INFO: Scrape type for CL62340: 2
2026-03-27 20:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3e73003-3a83-5d5a-8a79-2b45377372e8 with identifier: CL62340
2026-03-27 20:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e73003-3a83-5d5a-8a79-2b45377372e8 with scrape type 2
2026-03-27 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3e73003-3a83-5d5a-8a79-2b45377372e8 with scrape type 2
2026-03-27 20:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3e73003-3a83-5d5a-8a79-2b45377372e8, identifier: CL62340
2026-03-27 20:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3e73003-3a83-5d5a-8a79-2b45377372e8 with identifier: CL62340
2026-03-27 20:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3e73003-3a83-5d5a-8a79-2b45377372e8 with identifier: CL62340
2026-03-27 20:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3e73003-3a83-5d5a-8a79-2b45377372e8 with identifier: CL62340 to the API
2026-03-27 20:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:12:56Z',
 'fuel_type': 'diesel',
 'id': 'c3e73003-3a83-5d5a-8a79-2b45377372e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL62340',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 262030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-31',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CL62340%27 HTTP/1.1" 200 None
2026-03-27 20:32:29 [auto1.be] INFO: Saving data for CL62340: {'auction_closing_time': 1774714376.0, 'created_time': 1773301763.795825, 'last_price_update_time': 1774643549.169403}
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CL62340') HTTP/1.1" 204 0
2026-03-27 20:32:29 [auto1.be] INFO: Found listing with ID: KS62440
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS62440%27 HTTP/1.1" 200 None
2026-03-27 20:32:29 [auto1.be] INFO: Scrape type for KS62440: 2
2026-03-27 20:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55bd42de-871c-55c0-bd25-e2c457c43bcd with identifier: KS62440
2026-03-27 20:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55bd42de-871c-55c0-bd25-e2c457c43bcd with scrape type 2
2026-03-27 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55bd42de-871c-55c0-bd25-e2c457c43bcd with scrape type 2
2026-03-27 20:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 55bd42de-871c-55c0-bd25-e2c457c43bcd, identifier: KS62440
2026-03-27 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_f1e41b8bb6da184fd420ddcbaa3c77ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 55bd42de-871c-55c0-bd25-e2c457c43bcd with identifier: KS62440
2026-03-27 20:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 55bd42de-871c-55c0-bd25-e2c457c43bcd with identifier: KS62440
2026-03-27 20:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 55bd42de-871c-55c0-bd25-e2c457c43bcd with identifier: KS62440 to the API
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:03Z',
 'fuel_type': 'petrol',
 'id': '55bd42de-871c-55c0-bd25-e2c457c43bcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS62440',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 108092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-10',
 'seller_name': None,
 'title': 'BMW 1er 116i Edition M Sport Shadow',
 'transmission': 'manual',
 'trim': 'Edition M Sport Shadow',
 'year': 2018}
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS62440%27 HTTP/1.1" 200 None
2026-03-27 20:32:29 [auto1.be] INFO: Saving data for KS62440: {'auction_closing_time': 1774716603.0, 'created_time': 1773138127.940185, 'last_price_update_time': 1774643549.547823}
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KS62440') HTTP/1.1" 204 0
2026-03-27 20:32:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35991c490>
2026-03-27 20:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_343d7a20caaab9039b8865c9672ff77e.jpg') HTTP/1.1" 204 0
2026-03-27 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_343d7a20caaab9039b8865c9672ff77e.jpg saved to cache
2026-03-27 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555
2026-03-27 20:32:29 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-27 20:32:29 [auto1.be] INFO: Scrape type for HM84114: 0
2026-03-27 20:32:29 [auto1.be] INFO: Found listing with ID: ND85214
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND85214%27 HTTP/1.1" 200 None
2026-03-27 20:32:29 [auto1.be] INFO: Scrape type for ND85214: 2
2026-03-27 20:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3529a897-3158-5776-b2eb-2b3f34a4a3c8 with identifier: ND85214
2026-03-27 20:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3529a897-3158-5776-b2eb-2b3f34a4a3c8 with scrape type 2
2026-03-27 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3529a897-3158-5776-b2eb-2b3f34a4a3c8 with scrape type 2
2026-03-27 20:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3529a897-3158-5776-b2eb-2b3f34a4a3c8, identifier: ND85214
2026-03-27 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e180d39640baf260c594b26bf2b9edd3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3529a897-3158-5776-b2eb-2b3f34a4a3c8 with identifier: ND85214
2026-03-27 20:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3529a897-3158-5776-b2eb-2b3f34a4a3c8 with identifier: ND85214
2026-03-27 20:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3529a897-3158-5776-b2eb-2b3f34a4a3c8 with identifier: ND85214 to the API
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:51:19Z',
 'fuel_type': 'petrol',
 'id': '3529a897-3158-5776-b2eb-2b3f34a4a3c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND85214',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 103413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-21',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2018}
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND85214%27 HTTP/1.1" 200 None
2026-03-27 20:32:30 [auto1.be] INFO: Saving data for ND85214: {'auction_closing_time': 1774716679.0, 'created_time': 1774470973.772744, 'last_price_update_time': 1774643550.063833}
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ND85214') HTTP/1.1" 204 0
2026-03-27 20:32:30 [auto1.be] INFO: Found listing with ID: TF25932
2026-03-27 20:32:30 [auto1.be] INFO: Found listing with ID: BD17756
2026-03-27 20:32:30 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-27 20:32:30 [auto1.be] INFO: Found listing with ID: EA67135
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA67135%27 HTTP/1.1" 200 None
2026-03-27 20:32:30 [auto1.be] INFO: Scrape type for EA67135: 2
2026-03-27 20:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eb6d4b0-d13c-570e-85ca-41fb7abc5936 with identifier: EA67135
2026-03-27 20:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eb6d4b0-d13c-570e-85ca-41fb7abc5936 with scrape type 2
2026-03-27 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5eb6d4b0-d13c-570e-85ca-41fb7abc5936 with scrape type 2
2026-03-27 20:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5eb6d4b0-d13c-570e-85ca-41fb7abc5936, identifier: EA67135
2026-03-27 20:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5eb6d4b0-d13c-570e-85ca-41fb7abc5936 with identifier: EA67135
2026-03-27 20:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5eb6d4b0-d13c-570e-85ca-41fb7abc5936 with identifier: EA67135
2026-03-27 20:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5eb6d4b0-d13c-570e-85ca-41fb7abc5936 with identifier: EA67135 to the API
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-28T16:08:23Z',
 'fuel_type': 'petrol',
 'id': '5eb6d4b0-d13c-570e-85ca-41fb7abc5936',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA67135',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 157727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-24',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.6 PureTech Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2019}
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA67135%27 HTTP/1.1" 200 None
2026-03-27 20:32:30 [auto1.be] INFO: Saving data for EA67135: {'auction_closing_time': 1774714103.0, 'created_time': 1773134805.13888, 'last_price_update_time': 1774643550.439216}
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EA67135') HTTP/1.1" 204 0
2026-03-27 20:32:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536f3990>
2026-03-27 20:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_f1e41b8bb6da184fd420ddcbaa3c77ed.jpg') HTTP/1.1" 204 0
2026-03-27 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_f1e41b8bb6da184fd420ddcbaa3c77ed.jpg saved to cache
2026-03-27 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555
2026-03-27 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_861a3afd204bed17eaec73657c0b2b92.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:32:30 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-27 20:32:30 [auto1.be] INFO: Found listing with ID: WT96819
2026-03-27 20:32:30 [auto1.be] INFO: Found listing with ID: GE05105
2026-03-27 20:32:30 [auto1.be] INFO: Found listing with ID: XM85548
2026-03-27 20:32:30 [auto1.be] INFO: Found listing with ID: BE11259
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE11259%27 HTTP/1.1" 200 None
2026-03-27 20:32:30 [auto1.be] INFO: Scrape type for BE11259: 2
2026-03-27 20:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e691225d-b8f7-59df-a5c0-d821158dbe0b with identifier: BE11259
2026-03-27 20:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e691225d-b8f7-59df-a5c0-d821158dbe0b with scrape type 2
2026-03-27 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e691225d-b8f7-59df-a5c0-d821158dbe0b with scrape type 2
2026-03-27 20:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e691225d-b8f7-59df-a5c0-d821158dbe0b, identifier: BE11259
2026-03-27 20:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e691225d-b8f7-59df-a5c0-d821158dbe0b with identifier: BE11259
2026-03-27 20:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e691225d-b8f7-59df-a5c0-d821158dbe0b with identifier: BE11259
2026-03-27 20:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e691225d-b8f7-59df-a5c0-d821158dbe0b with identifier: BE11259 to the API
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:21:49Z',
 'fuel_type': 'diesel',
 'id': 'e691225d-b8f7-59df-a5c0-d821158dbe0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE11259',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 88834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2014}
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE11259%27 HTTP/1.1" 200 None
2026-03-27 20:32:31 [auto1.be] INFO: Saving data for BE11259: {'auction_closing_time': 1774714909.0, 'created_time': 1774470995.415513, 'last_price_update_time': 1774643551.192064}
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BE11259') HTTP/1.1" 204 0
2026-03-27 20:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS48856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35343a090>
2026-03-27 20:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_e180d39640baf260c594b26bf2b9edd3.jpg') HTTP/1.1" 204 0
2026-03-27 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e180d39640baf260c594b26bf2b9edd3.jpg saved to cache
2026-03-27 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555
2026-03-27 20:32:31 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-27 20:32:31 [auto1.be] INFO: Found listing with ID: EP73132
2026-03-27 20:32:31 [auto1.be] INFO: Found listing with ID: LH22912
2026-03-27 20:32:31 [auto1.be] INFO: Found listing with ID: WP33906
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP33906%27 HTTP/1.1" 200 None
2026-03-27 20:32:31 [auto1.be] INFO: Scrape type for WP33906: 2
2026-03-27 20:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 890f37e8-6ad7-5506-adba-9567804e4649 with identifier: WP33906
2026-03-27 20:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 890f37e8-6ad7-5506-adba-9567804e4649 with scrape type 2
2026-03-27 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 890f37e8-6ad7-5506-adba-9567804e4649 with scrape type 2
2026-03-27 20:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 890f37e8-6ad7-5506-adba-9567804e4649, identifier: WP33906
2026-03-27 20:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 890f37e8-6ad7-5506-adba-9567804e4649 with identifier: WP33906
2026-03-27 20:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 890f37e8-6ad7-5506-adba-9567804e4649 with identifier: WP33906
2026-03-27 20:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 890f37e8-6ad7-5506-adba-9567804e4649 with identifier: WP33906 to the API
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:05:48Z',
 'fuel_type': 'diesel',
 'id': '890f37e8-6ad7-5506-adba-9567804e4649',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP33906',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 152034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-05',
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 CDTI DPF Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP33906%27 HTTP/1.1" 200 None
2026-03-27 20:32:31 [auto1.be] INFO: Saving data for WP33906: {'auction_closing_time': 1774713948.0, 'created_time': 1773131688.548343, 'last_price_update_time': 1774643551.785969}
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP33906') HTTP/1.1" 204 0
2026-03-27 20:32:31 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU67376%27 HTTP/1.1" 200 None
2026-03-27 20:32:31 [auto1.be] INFO: Scrape type for VU67376: 1
2026-03-27 20:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN65088> (referer: https://www.auto1.com/v1/car-details-view/XN65088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB61651> (referer: https://www.auto1.com/v1/car-details-view/MB61651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353432b10>
2026-03-27 20:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F52%252F3552f1dc4f6d54454b6eb69c364dfb70%252Fpa%252FKP16725_861a3afd204bed17eaec73657c0b2b92.jpg') HTTP/1.1" 204 0
2026-03-27 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_861a3afd204bed17eaec73657c0b2b92.jpg saved to cache
2026-03-27 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555
2026-03-27 20:32:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555, skipping ID generation
2026-03-27 20:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with scrape type 1
2026-03-27 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 sending to next pipeline
2026-03-27 20:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555, identifier: KP16725
2026-03-27 20:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725
2026-03-27 20:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725
2026-03-27 20:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725 to the API
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_861a3afd204bed17eaec73657c0b2b92.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:10:51Z',
 'fuel_type': 'diesel',
 'id': '14f4e165-c34a-5cd5-b1b6-03f31b3cf555',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP16725',
 'listing': 'auction',
 'location': 'BE, Wanze',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 152527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3602120,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e76db4a48716d9ec7621dfe054d6c4ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3608062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_27a7f76b64bb49edc584b4c05ed723b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3483959,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_c8a0f02724982f1d388cdea4a1460ac7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3155042,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_861a3afd204bed17eaec73657c0b2b92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2991728,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_f1e41b8bb6da184fd420ddcbaa3c77ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3204099,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_ed83dc677722e06b9e62a2a64816e01f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3402467,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_ec054877ee769add088d1a30006fe1c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e547669420141ffbd50e01b4260a77e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3352074,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_e180d39640baf260c594b26bf2b9edd3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4e165-c34a-5cd5-b1b6-03f31b3cf555/14f4e165-c34a-5cd5-b1b6-03f31b3cf555_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2874407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/52/3552f1dc4f6d54454b6eb69c364dfb70/pa/KP16725_343d7a20caaab9039b8865c9672ff77e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-24',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L2H2 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H2 2,9t',
 'year': 2018}
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-27 20:32:32 [auto1.be] INFO: Saving data for KP16725: {'created_time': 1774643552.3746, 'last_price_update_time': 1774643552.37461, 'auction_closing_time': 1774714251.0}
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP16725') HTTP/1.1" 204 0
2026-03-27 20:32:32 [auto1.be] INFO: Found listing with ID: YK21410
2026-03-27 20:32:32 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-27 20:32:32 [auto1.be] INFO: Scrape type for VH38978: 2
2026-03-27 20:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978
2026-03-27 20:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bce93e7-3742-5e77-aea9-ff747806c471 with scrape type 2
2026-03-27 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bce93e7-3742-5e77-aea9-ff747806c471 with scrape type 2
2026-03-27 20:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1bce93e7-3742-5e77-aea9-ff747806c471, identifier: VH38978
2026-03-27 20:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978
2026-03-27 20:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978
2026-03-27 20:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978 to the API
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:39:15Z',
 'fuel_type': 'diesel',
 'id': '1bce93e7-3742-5e77-aea9-ff747806c471',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH38978',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 123493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-02',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2014}
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-27 20:32:32 [auto1.be] INFO: Saving data for VH38978: {'auction_closing_time': 1774715955.0, 'created_time': 1774557070.813886, 'last_price_update_time': 1774643552.785034}
2026-03-27 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VH38978') HTTP/1.1" 204 0
2026-03-27 20:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:33 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1659 | hits on page: 40
2026-03-27 20:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b946eec-c73b-5d51-8e36-0bb30e0976ac with identifier: XN65088
2026-03-27 20:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b946eec-c73b-5d51-8e36-0bb30e0976ac with scrape type 1
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b946eec-c73b-5d51-8e36-0bb30e0976ac
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F7e%252F0e7efc8dfc1d09999f13333c5b2ba84f%252Fpa%252FXN65088_8796608ced34219a70cc13d7166dd73c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_8796608ced34219a70cc13d7166dd73c.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F7e%252F0e7efc8dfc1d09999f13333c5b2ba84f%252Fpa%252FXN65088_268df4c84199a327b9fd7fa10dff61e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_268df4c84199a327b9fd7fa10dff61e6.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F7e%252F0e7efc8dfc1d09999f13333c5b2ba84f%252Fpa%252FXN65088_6aa9eb7451599bdc3bc78bed7a8abcb0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_6aa9eb7451599bdc3bc78bed7a8abcb0.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F7e%252F0e7efc8dfc1d09999f13333c5b2ba84f%252Fpa%252FXN65088_813dcf7891b7dae1b8566235ade96a14.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_813dcf7891b7dae1b8566235ade96a14.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F7e%252F0e7efc8dfc1d09999f13333c5b2ba84f%252Fpa%252FXN65088_11b1b4508419de40b270d2a02cc670ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_11b1b4508419de40b270d2a02cc670ae.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F7e%252F0e7efc8dfc1d09999f13333c5b2ba84f%252Fpa%252FXN65088_ad557a64d2f6d1a277ff132e5cee12ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_ad557a64d2f6d1a277ff132e5cee12ad.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F7e%252F0e7efc8dfc1d09999f13333c5b2ba84f%252Fpa%252FXN65088_0947bf37c4403fd07d305d99cdba7c12.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_0947bf37c4403fd07d305d99cdba7c12.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F7e%252F0e7efc8dfc1d09999f13333c5b2ba84f%252Fpa%252FXN65088_56436206d8e5449119cb8af60d525c4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_56436206d8e5449119cb8af60d525c4a.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F7e%252F0e7efc8dfc1d09999f13333c5b2ba84f%252Fpa%252FXN65088_05a0bf03c93fe3de34389826b7e69fa5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_05a0bf03c93fe3de34389826b7e69fa5.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F7e%252F0e7efc8dfc1d09999f13333c5b2ba84f%252Fpa%252FXN65088_77b94c67803350e19d3300933b80207f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_77b94c67803350e19d3300933b80207f.jpg already downloaded
2026-03-27 20:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b946eec-c73b-5d51-8e36-0bb30e0976ac, identifier: XN65088
2026-03-27 20:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d6608ce-b53a-5099-b394-88aec669f432 with identifier: MB61651
2026-03-27 20:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d6608ce-b53a-5099-b394-88aec669f432 with scrape type 1
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d6608ce-b53a-5099-b394-88aec669f432
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F2d%252F822d270677f30eda11508848669f6048%252Fpa%252FMB61651_a78f5b0e9d3637f0d6716b7b6dcd033f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_a78f5b0e9d3637f0d6716b7b6dcd033f.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F2d%252F822d270677f30eda11508848669f6048%252Fpa%252FMB61651_7581536c3da1e71b9a60e986755ed18c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_7581536c3da1e71b9a60e986755ed18c.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F2d%252F822d270677f30eda11508848669f6048%252Fpa%252FMB61651_7ff1d9c8536b3fa082beaa6dcb9f3d8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_7ff1d9c8536b3fa082beaa6dcb9f3d8d.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F2d%252F822d270677f30eda11508848669f6048%252Fpa%252FMB61651_1af8b6eb4c09bc88e58956bde572b68c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_1af8b6eb4c09bc88e58956bde572b68c.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F2d%252F822d270677f30eda11508848669f6048%252Fpa%252FMB61651_8394646ec47d01d8d8367953f4b8fdd1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_8394646ec47d01d8d8367953f4b8fdd1.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F2d%252F822d270677f30eda11508848669f6048%252Fpa%252FMB61651_a7d76d0772f3917da91bb55e39bd2f15.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_a7d76d0772f3917da91bb55e39bd2f15.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F2d%252F822d270677f30eda11508848669f6048%252Fpa%252FMB61651_aabf46e0e4e8d9109b3562ff39bba47a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_aabf46e0e4e8d9109b3562ff39bba47a.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F2d%252F822d270677f30eda11508848669f6048%252Fpa%252FMB61651_029f6b28d39a968fbfb41f572c1360dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_029f6b28d39a968fbfb41f572c1360dc.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F2d%252F822d270677f30eda11508848669f6048%252Fpa%252FMB61651_b80af36e1e2690632ce1038d9c94bf94.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_b80af36e1e2690632ce1038d9c94bf94.jpg already downloaded
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F2d%252F822d270677f30eda11508848669f6048%252Fpa%252FMB61651_d74c2b570d85f2945fed190fc3718ec6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_d74c2b570d85f2945fed190fc3718ec6.jpg already downloaded
2026-03-27 20:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1d6608ce-b53a-5099-b394-88aec669f432, identifier: MB61651
2026-03-27 20:32:34 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ53898%27 HTTP/1.1" 200 None
2026-03-27 20:32:34 [auto1.be] INFO: Scrape type for TZ53898: 0
2026-03-27 20:32:34 [auto1.be] INFO: Found listing with ID: HN48415
2026-03-27 20:32:34 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR41774%27 HTTP/1.1" 200 None
2026-03-27 20:32:34 [auto1.be] INFO: Scrape type for WR41774: 0
2026-03-27 20:32:34 [auto1.be] INFO: Found listing with ID: ZX75796
2026-03-27 20:32:34 [auto1.be] INFO: Found listing with ID: WN00182
2026-03-27 20:32:34 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-27 20:32:34 [auto1.be] INFO: Scrape type for TU47744: 0
2026-03-27 20:32:34 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-27 20:32:34 [auto1.be] INFO: Scrape type for ZK51287: 0
2026-03-27 20:32:34 [auto1.be] INFO: Found listing with ID: RK77715
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK77715%27 HTTP/1.1" 200 None
2026-03-27 20:32:34 [auto1.be] INFO: Scrape type for RK77715: 2
2026-03-27 20:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28bf5dd2-4a80-5e93-862e-bed4904517c3 with identifier: RK77715
2026-03-27 20:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28bf5dd2-4a80-5e93-862e-bed4904517c3 with scrape type 2
2026-03-27 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28bf5dd2-4a80-5e93-862e-bed4904517c3 with scrape type 2
2026-03-27 20:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 28bf5dd2-4a80-5e93-862e-bed4904517c3, identifier: RK77715
2026-03-27 20:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b946eec-c73b-5d51-8e36-0bb30e0976ac with identifier: XN65088
2026-03-27 20:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b946eec-c73b-5d51-8e36-0bb30e0976ac with identifier: XN65088
2026-03-27 20:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b946eec-c73b-5d51-8e36-0bb30e0976ac with identifier: XN65088 to the API
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XN65088>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:39:47Z',
 'fuel_type': 'diesel',
 'id': '1b946eec-c73b-5d51-8e36-0bb30e0976ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN65088',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '2er',
 'odometer': 77236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_8796608ced34219a70cc13d7166dd73c.jpg',
                'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_268df4c84199a327b9fd7fa10dff61e6.jpg',
                'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_6aa9eb7451599bdc3bc78bed7a8abcb0.jpg',
                'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_813dcf7891b7dae1b8566235ade96a14.jpg',
                'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_11b1b4508419de40b270d2a02cc670ae.jpg',
                'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_ad557a64d2f6d1a277ff132e5cee12ad.jpg',
                'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_0947bf37c4403fd07d305d99cdba7c12.jpg',
                'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_56436206d8e5449119cb8af60d525c4a.jpg',
                'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_05a0bf03c93fe3de34389826b7e69fa5.jpg',
                'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_77b94c67803350e19d3300933b80207f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b946eec-c73b-5d51-8e36-0bb30e0976ac/1b946eec-c73b-5d51-8e36-0bb30e0976ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_8796608ced34219a70cc13d7166dd73c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b946eec-c73b-5d51-8e36-0bb30e0976ac/1b946eec-c73b-5d51-8e36-0bb30e0976ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_268df4c84199a327b9fd7fa10dff61e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b946eec-c73b-5d51-8e36-0bb30e0976ac/1b946eec-c73b-5d51-8e36-0bb30e0976ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_6aa9eb7451599bdc3bc78bed7a8abcb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b946eec-c73b-5d51-8e36-0bb30e0976ac/1b946eec-c73b-5d51-8e36-0bb30e0976ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_813dcf7891b7dae1b8566235ade96a14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b946eec-c73b-5d51-8e36-0bb30e0976ac/1b946eec-c73b-5d51-8e36-0bb30e0976ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_11b1b4508419de40b270d2a02cc670ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b946eec-c73b-5d51-8e36-0bb30e0976ac/1b946eec-c73b-5d51-8e36-0bb30e0976ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_ad557a64d2f6d1a277ff132e5cee12ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b946eec-c73b-5d51-8e36-0bb30e0976ac/1b946eec-c73b-5d51-8e36-0bb30e0976ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_0947bf37c4403fd07d305d99cdba7c12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b946eec-c73b-5d51-8e36-0bb30e0976ac/1b946eec-c73b-5d51-8e36-0bb30e0976ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_56436206d8e5449119cb8af60d525c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b946eec-c73b-5d51-8e36-0bb30e0976ac/1b946eec-c73b-5d51-8e36-0bb30e0976ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_05a0bf03c93fe3de34389826b7e69fa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b946eec-c73b-5d51-8e36-0bb30e0976ac/1b946eec-c73b-5d51-8e36-0bb30e0976ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7efc8dfc1d09999f13333c5b2ba84f/pa/XN65088_77b94c67803350e19d3300933b80207f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Coupe xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2020}
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN65088%27 HTTP/1.1" 200 None
2026-03-27 20:32:34 [auto1.be] INFO: Saving data for XN65088: {'created_time': 1774643554.48824, 'last_price_update_time': 1774643554.488252, 'auction_closing_time': 1774715987.0}
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XN65088') HTTP/1.1" 204 0
2026-03-27 20:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1d6608ce-b53a-5099-b394-88aec669f432 with identifier: MB61651
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-27 20:32:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1d6608ce-b53a-5099-b394-88aec669f432 with identifier: MB61651
2026-03-27 20:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1d6608ce-b53a-5099-b394-88aec669f432 with identifier: MB61651 to the API
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB61651>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:23:54Z',
 'fuel_type': 'petrol',
 'id': '1d6608ce-b53a-5099-b394-88aec669f432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB61651',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 29676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_a78f5b0e9d3637f0d6716b7b6dcd033f.jpg',
                'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_7581536c3da1e71b9a60e986755ed18c.jpg',
                'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_7ff1d9c8536b3fa082beaa6dcb9f3d8d.jpg',
                'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_1af8b6eb4c09bc88e58956bde572b68c.jpg',
                'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_8394646ec47d01d8d8367953f4b8fdd1.jpg',
                'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_a7d76d0772f3917da91bb55e39bd2f15.jpg',
                'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_aabf46e0e4e8d9109b3562ff39bba47a.jpg',
                'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_029f6b28d39a968fbfb41f572c1360dc.jpg',
                'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_b80af36e1e2690632ce1038d9c94bf94.jpg',
                'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_d74c2b570d85f2945fed190fc3718ec6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d6608ce-b53a-5099-b394-88aec669f432/1d6608ce-b53a-5099-b394-88aec669f432_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42749,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_a78f5b0e9d3637f0d6716b7b6dcd033f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d6608ce-b53a-5099-b394-88aec669f432/1d6608ce-b53a-5099-b394-88aec669f432_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_7581536c3da1e71b9a60e986755ed18c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d6608ce-b53a-5099-b394-88aec669f432/1d6608ce-b53a-5099-b394-88aec669f432_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_7ff1d9c8536b3fa082beaa6dcb9f3d8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d6608ce-b53a-5099-b394-88aec669f432/1d6608ce-b53a-5099-b394-88aec669f432_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_1af8b6eb4c09bc88e58956bde572b68c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d6608ce-b53a-5099-b394-88aec669f432/1d6608ce-b53a-5099-b394-88aec669f432_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_8394646ec47d01d8d8367953f4b8fdd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d6608ce-b53a-5099-b394-88aec669f432/1d6608ce-b53a-5099-b394-88aec669f432_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_a7d76d0772f3917da91bb55e39bd2f15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d6608ce-b53a-5099-b394-88aec669f432/1d6608ce-b53a-5099-b394-88aec669f432_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_aabf46e0e4e8d9109b3562ff39bba47a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d6608ce-b53a-5099-b394-88aec669f432/1d6608ce-b53a-5099-b394-88aec669f432_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_029f6b28d39a968fbfb41f572c1360dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d6608ce-b53a-5099-b394-88aec669f432/1d6608ce-b53a-5099-b394-88aec669f432_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_b80af36e1e2690632ce1038d9c94bf94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d6608ce-b53a-5099-b394-88aec669f432/1d6608ce-b53a-5099-b394-88aec669f432_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42099,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img82/2d/822d270677f30eda11508848669f6048/pa/MB61651_d74c2b570d85f2945fed190fc3718ec6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.8 TCe R.S. Trophy',
 'transmission': 'automatic',
 'trim': 'R.S. Trophy',
 'year': 2020}
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB61651%27 HTTP/1.1" 200 None
2026-03-27 20:32:34 [auto1.be] INFO: Saving data for MB61651: {'created_time': 1774643554.975038, 'last_price_update_time': 1774643554.975049, 'auction_closing_time': 1774715034.0}
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB61651') HTTP/1.1" 204 0
2026-03-27 20:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 28bf5dd2-4a80-5e93-862e-bed4904517c3 with identifier: RK77715
2026-03-27 20:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 28bf5dd2-4a80-5e93-862e-bed4904517c3 with identifier: RK77715
2026-03-27 20:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 28bf5dd2-4a80-5e93-862e-bed4904517c3 with identifier: RK77715 to the API
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:34:46Z',
 'fuel_type': 'petrol',
 'id': '28bf5dd2-4a80-5e93-862e-bed4904517c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK77715',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 78772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-19',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK77715%27 HTTP/1.1" 200 None
2026-03-27 20:32:35 [auto1.be] INFO: Saving data for RK77715: {'auction_closing_time': 1774715686.0, 'created_time': 1774297992.363828, 'last_price_update_time': 1774643555.285222}
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK77715') HTTP/1.1" 204 0
2026-03-27 20:32:35 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS28625%27 HTTP/1.1" 200 None
2026-03-27 20:32:35 [auto1.be] INFO: Scrape type for PS28625: 2
2026-03-27 20:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21965b2e-9e92-567d-9030-70078a563c71 with identifier: PS28625
2026-03-27 20:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21965b2e-9e92-567d-9030-70078a563c71 with scrape type 2
2026-03-27 20:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21965b2e-9e92-567d-9030-70078a563c71 with scrape type 2
2026-03-27 20:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 21965b2e-9e92-567d-9030-70078a563c71, identifier: PS28625
2026-03-27 20:32:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:35 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-27 20:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 21965b2e-9e92-567d-9030-70078a563c71 with identifier: PS28625
2026-03-27 20:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 21965b2e-9e92-567d-9030-70078a563c71 with identifier: PS28625
2026-03-27 20:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 21965b2e-9e92-567d-9030-70078a563c71 with identifier: PS28625 to the API
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:48Z',
 'fuel_type': 'diesel',
 'id': '21965b2e-9e92-567d-9030-70078a563c71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS28625',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 208983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CDI BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS28625%27 HTTP/1.1" 200 None
2026-03-27 20:32:35 [auto1.be] INFO: Saving data for PS28625: {'auction_closing_time': 1774716768.0, 'created_time': 1773135813.778567, 'last_price_update_time': 1774643555.677703}
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS28625') HTTP/1.1" 204 0
2026-03-27 20:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD12606> (referer: https://www.auto1.com/v1/car-details-view/SD12606/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:35 [auto1.be] INFO: Found listing with ID: HF21497
2026-03-27 20:32:35 [auto1.be] INFO: Found listing with ID: CK03982
2026-03-27 20:32:35 [auto1.be] INFO: Found listing with ID: CH15441
2026-03-27 20:32:35 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-27 20:32:35 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-27 20:32:35 [auto1.be] INFO: Scrape type for DF96327: 2
2026-03-27 20:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327
2026-03-27 20:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with scrape type 2
2026-03-27 20:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with scrape type 2
2026-03-27 20:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f, identifier: DF96327
2026-03-27 20:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327
2026-03-27 20:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327
2026-03-27 20:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327 to the API
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:13:41Z',
 'fuel_type': 'diesel',
 'id': '8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF96327',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 171018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-05',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [auto1.be] INFO: Saving data for DF96327: {'auction_closing_time': 1774714421.0, 'created_time': 1774557059.321687, 'last_price_update_time': 1774643556.065221}
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF96327') HTTP/1.1" 204 0
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: YC19133
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC19133%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [auto1.be] INFO: Scrape type for YC19133: 1
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [auto1.be] INFO: Scrape type for SZ65946: 0
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: AB27373
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB27373%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [auto1.be] INFO: Scrape type for AB27373: 0
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: WG60858
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: YN58260
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: ZC53588
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: GH28824
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH28824%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [auto1.be] INFO: Scrape type for GH28824: 0
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: DC51589
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC51589%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [auto1.be] INFO: Scrape type for DC51589: 2
2026-03-27 20:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b826fafd-0961-53fe-b2a1-c9da65282487 with identifier: DC51589
2026-03-27 20:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b826fafd-0961-53fe-b2a1-c9da65282487 with scrape type 2
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b826fafd-0961-53fe-b2a1-c9da65282487 with scrape type 2
2026-03-27 20:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b826fafd-0961-53fe-b2a1-c9da65282487, identifier: DC51589
2026-03-27 20:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b826fafd-0961-53fe-b2a1-c9da65282487 with identifier: DC51589
2026-03-27 20:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b826fafd-0961-53fe-b2a1-c9da65282487 with identifier: DC51589
2026-03-27 20:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b826fafd-0961-53fe-b2a1-c9da65282487 with identifier: DC51589 to the API
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:07:51Z',
 'fuel_type': 'diesel',
 'id': 'b826fafd-0961-53fe-b2a1-c9da65282487',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC51589',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 85813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-23',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 d Sport Edition',
 'transmission': 'automatic',
 'trim': 'Sport Edition',
 'year': 2016}
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC51589%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [auto1.be] INFO: Saving data for DC51589: {'auction_closing_time': 1774714071.0, 'created_time': 1774438275.988163, 'last_price_update_time': 1774643556.580435}
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DC51589') HTTP/1.1" 204 0
2026-03-27 20:32:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94265d71-e0e7-51ee-af41-e4112ae021d1 with identifier: SD12606
2026-03-27 20:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94265d71-e0e7-51ee-af41-e4112ae021d1 with scrape type 1
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94265d71-e0e7-51ee-af41-e4112ae021d1
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F25%252F7b257baf1384462e8c1d395561c8bee1%252Fpa%252FSD12606_52d3594b2b6288faa885459a4344946f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_52d3594b2b6288faa885459a4344946f.jpg already downloaded
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F25%252F7b257baf1384462e8c1d395561c8bee1%252Fpa%252FSD12606_d491b277f9615ffb4fe16789739daf85.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_d491b277f9615ffb4fe16789739daf85.jpg already downloaded
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F25%252F7b257baf1384462e8c1d395561c8bee1%252Fpa%252FSD12606_a6921e801d2134a6a8a216569ad72e85.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_a6921e801d2134a6a8a216569ad72e85.jpg already downloaded
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F25%252F7b257baf1384462e8c1d395561c8bee1%252Fpa%252FSD12606_cd65ac9d3da104c5e5c1fd5d662ff735.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_cd65ac9d3da104c5e5c1fd5d662ff735.jpg already downloaded
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F25%252F7b257baf1384462e8c1d395561c8bee1%252Fpa%252FSD12606_c4e02b20c65d8aa4d9c3ca26d91a4045.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_c4e02b20c65d8aa4d9c3ca26d91a4045.jpg already downloaded
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F25%252F7b257baf1384462e8c1d395561c8bee1%252Fpa%252FSD12606_af21114e16ab2225f0d233810085b23e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_af21114e16ab2225f0d233810085b23e.jpg already downloaded
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F25%252F7b257baf1384462e8c1d395561c8bee1%252Fpa%252FSD12606_4deabcd6f603d3eaab832cd003a5ccfb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_4deabcd6f603d3eaab832cd003a5ccfb.jpg already downloaded
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F25%252F7b257baf1384462e8c1d395561c8bee1%252Fpa%252FSD12606_a849f0d8efd55fc5ca0dc0359fa7e5b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_a849f0d8efd55fc5ca0dc0359fa7e5b0.jpg already downloaded
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F25%252F7b257baf1384462e8c1d395561c8bee1%252Fpa%252FSD12606_ed65dec5dbcb19b9d439fd2a8de7b2ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_ed65dec5dbcb19b9d439fd2a8de7b2ae.jpg already downloaded
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F25%252F7b257baf1384462e8c1d395561c8bee1%252Fpa%252FSD12606_280b915bc58d40ebc1220ace37d551d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_280b915bc58d40ebc1220ace37d551d4.jpg already downloaded
2026-03-27 20:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94265d71-e0e7-51ee-af41-e4112ae021d1, identifier: SD12606
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: PA07784
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: MM41011
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM41011%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [auto1.be] INFO: Scrape type for MM41011: 0
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: JL24574
2026-03-27 20:32:36 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-27 20:32:36 [auto1.be] INFO: Scrape type for NM84060: 1
2026-03-27 20:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94265d71-e0e7-51ee-af41-e4112ae021d1 with identifier: SD12606
2026-03-27 20:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94265d71-e0e7-51ee-af41-e4112ae021d1 with identifier: SD12606
2026-03-27 20:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94265d71-e0e7-51ee-af41-e4112ae021d1 with identifier: SD12606 to the API
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SD12606>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:07:15Z',
 'fuel_type': 'diesel',
 'id': '94265d71-e0e7-51ee-af41-e4112ae021d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD12606',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 136745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_52d3594b2b6288faa885459a4344946f.jpg',
                'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_d491b277f9615ffb4fe16789739daf85.jpg',
                'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_a6921e801d2134a6a8a216569ad72e85.jpg',
                'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_cd65ac9d3da104c5e5c1fd5d662ff735.jpg',
                'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_c4e02b20c65d8aa4d9c3ca26d91a4045.jpg',
                'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_af21114e16ab2225f0d233810085b23e.jpg',
                'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_4deabcd6f603d3eaab832cd003a5ccfb.jpg',
                'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_a849f0d8efd55fc5ca0dc0359fa7e5b0.jpg',
                'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_ed65dec5dbcb19b9d439fd2a8de7b2ae.jpg',
                'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_280b915bc58d40ebc1220ace37d551d4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94265d71-e0e7-51ee-af41-e4112ae021d1/94265d71-e0e7-51ee-af41-e4112ae021d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_52d3594b2b6288faa885459a4344946f.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94265d71-e0e7-51ee-af41-e4112ae021d1/94265d71-e0e7-51ee-af41-e4112ae021d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_d491b277f9615ffb4fe16789739daf85.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94265d71-e0e7-51ee-af41-e4112ae021d1/94265d71-e0e7-51ee-af41-e4112ae021d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_a6921e801d2134a6a8a216569ad72e85.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94265d71-e0e7-51ee-af41-e4112ae021d1/94265d71-e0e7-51ee-af41-e4112ae021d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_cd65ac9d3da104c5e5c1fd5d662ff735.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94265d71-e0e7-51ee-af41-e4112ae021d1/94265d71-e0e7-51ee-af41-e4112ae021d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_c4e02b20c65d8aa4d9c3ca26d91a4045.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94265d71-e0e7-51ee-af41-e4112ae021d1/94265d71-e0e7-51ee-af41-e4112ae021d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_af21114e16ab2225f0d233810085b23e.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94265d71-e0e7-51ee-af41-e4112ae021d1/94265d71-e0e7-51ee-af41-e4112ae021d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_4deabcd6f603d3eaab832cd003a5ccfb.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94265d71-e0e7-51ee-af41-e4112ae021d1/94265d71-e0e7-51ee-af41-e4112ae021d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_a849f0d8efd55fc5ca0dc0359fa7e5b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94265d71-e0e7-51ee-af41-e4112ae021d1/94265d71-e0e7-51ee-af41-e4112ae021d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_ed65dec5dbcb19b9d439fd2a8de7b2ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94265d71-e0e7-51ee-af41-e4112ae021d1/94265d71-e0e7-51ee-af41-e4112ae021d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/25/7b257baf1384462e8c1d395561c8bee1/pa/SD12606_280b915bc58d40ebc1220ace37d551d4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 Blue-HDi Business XS',
 'transmission': 'manual',
 'trim': 'Business XS',
 'year': 2017}
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD12606%27 HTTP/1.1" 200 None
2026-03-27 20:32:37 [auto1.be] INFO: Saving data for SD12606: {'created_time': 1774643557.210392, 'last_price_update_time': 1774643557.210402, 'auction_closing_time': 1774714035.0}
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD12606') HTTP/1.1" 204 0
2026-03-27 20:32:37 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-27 20:32:37 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-27 20:32:37 [auto1.be] INFO: Scrape type for SD20873: 2
2026-03-27 20:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873
2026-03-27 20:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a377605a-c058-5b4f-99e8-896e420b40df with scrape type 2
2026-03-27 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a377605a-c058-5b4f-99e8-896e420b40df with scrape type 2
2026-03-27 20:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a377605a-c058-5b4f-99e8-896e420b40df, identifier: SD20873
2026-03-27 20:32:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873
2026-03-27 20:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873
2026-03-27 20:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873 to the API
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:56:55Z',
 'fuel_type': 'diesel',
 'id': 'a377605a-c058-5b4f-99e8-896e420b40df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD20873',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 144987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-16',
 'seller_name': None,
 'title': 'Opel Zafira 2.0 DTI Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2003}
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-27 20:32:37 [auto1.be] INFO: Saving data for SD20873: {'auction_closing_time': 1774717015.0, 'created_time': 1774470971.15276, 'last_price_update_time': 1774643557.699182}
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD20873') HTTP/1.1" 204 0
2026-03-27 20:32:37 [auto1.be] INFO: Found listing with ID: GB18331
2026-03-27 20:32:37 [auto1.be] INFO: Found listing with ID: NB44505
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB44505%27 HTTP/1.1" 200 None
2026-03-27 20:32:37 [auto1.be] INFO: Scrape type for NB44505: 0
2026-03-27 20:32:37 [auto1.be] INFO: Found listing with ID: ZJ69289
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ69289%27 HTTP/1.1" 200 None
2026-03-27 20:32:37 [auto1.be] INFO: Scrape type for ZJ69289: 0
2026-03-27 20:32:37 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-27 20:32:37 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ12403%27 HTTP/1.1" 200 None
2026-03-27 20:32:37 [auto1.be] INFO: Scrape type for HJ12403: 2
2026-03-27 20:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with identifier: HJ12403
2026-03-27 20:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with scrape type 2
2026-03-27 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with scrape type 2
2026-03-27 20:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a, identifier: HJ12403
2026-03-27 20:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with identifier: HJ12403
2026-03-27 20:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with identifier: HJ12403
2026-03-27 20:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with identifier: HJ12403 to the API
2026-03-27 20:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:21:17Z',
 'fuel_type': 'hybrid',
 'id': '2a8bdbec-aa77-5ef7-93cf-bad4a183d31a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ12403',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 219401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ12403%27 HTTP/1.1" 200 None
2026-03-27 20:32:38 [auto1.be] INFO: Saving data for HJ12403: {'auction_closing_time': 1774714877.0, 'created_time': 1773301638.532618, 'last_price_update_time': 1774643558.135872}
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ12403') HTTP/1.1" 204 0
2026-03-27 20:32:38 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-27 20:32:38 [auto1.be] INFO: Found listing with ID: RE83981
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE83981%27 HTTP/1.1" 200 None
2026-03-27 20:32:38 [auto1.be] INFO: Scrape type for RE83981: 2
2026-03-27 20:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45d9618b-6fd7-52cd-8e38-f6f2fee5fb84 with identifier: RE83981
2026-03-27 20:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45d9618b-6fd7-52cd-8e38-f6f2fee5fb84 with scrape type 2
2026-03-27 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45d9618b-6fd7-52cd-8e38-f6f2fee5fb84 with scrape type 2
2026-03-27 20:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45d9618b-6fd7-52cd-8e38-f6f2fee5fb84, identifier: RE83981
2026-03-27 20:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45d9618b-6fd7-52cd-8e38-f6f2fee5fb84 with identifier: RE83981
2026-03-27 20:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45d9618b-6fd7-52cd-8e38-f6f2fee5fb84 with identifier: RE83981
2026-03-27 20:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45d9618b-6fd7-52cd-8e38-f6f2fee5fb84 with identifier: RE83981 to the API
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-28T16:14:29Z',
 'fuel_type': 'diesel',
 'id': '45d9618b-6fd7-52cd-8e38-f6f2fee5fb84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE83981',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 135968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE83981%27 HTTP/1.1" 200 None
2026-03-27 20:32:38 [auto1.be] INFO: Saving data for RE83981: {'auction_closing_time': 1774714469.0, 'created_time': 1774438256.837271, 'last_price_update_time': 1774643558.547515}
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RE83981') HTTP/1.1" 204 0
2026-03-27 20:32:38 [auto1.be] INFO: Found listing with ID: EM39704
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM39704%27 HTTP/1.1" 200 None
2026-03-27 20:32:38 [auto1.be] INFO: Scrape type for EM39704: 2
2026-03-27 20:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffb8beb9-d952-5e50-8d5e-8212a5fa5e5e with identifier: EM39704
2026-03-27 20:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb8beb9-d952-5e50-8d5e-8212a5fa5e5e with scrape type 2
2026-03-27 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffb8beb9-d952-5e50-8d5e-8212a5fa5e5e with scrape type 2
2026-03-27 20:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ffb8beb9-d952-5e50-8d5e-8212a5fa5e5e, identifier: EM39704
2026-03-27 20:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ffb8beb9-d952-5e50-8d5e-8212a5fa5e5e with identifier: EM39704
2026-03-27 20:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ffb8beb9-d952-5e50-8d5e-8212a5fa5e5e with identifier: EM39704
2026-03-27 20:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ffb8beb9-d952-5e50-8d5e-8212a5fa5e5e with identifier: EM39704 to the API
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:42:22Z',
 'fuel_type': 'diesel',
 'id': 'ffb8beb9-d952-5e50-8d5e-8212a5fa5e5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM39704',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 250980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-06',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 250 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2015}
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM39704%27 HTTP/1.1" 200 None
2026-03-27 20:32:38 [auto1.be] INFO: Saving data for EM39704: {'auction_closing_time': 1774716142.0, 'created_time': 1774438224.427106, 'last_price_update_time': 1774643558.950678}
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EM39704') HTTP/1.1" 204 0
2026-03-27 20:32:38 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-27 20:32:38 [auto1.be] INFO: Scrape type for RM46702: 2
2026-03-27 20:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702
2026-03-27 20:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc0e1375-1c24-52fe-bef3-32e29d915a60 with scrape type 2
2026-03-27 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc0e1375-1c24-52fe-bef3-32e29d915a60 with scrape type 2
2026-03-27 20:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc0e1375-1c24-52fe-bef3-32e29d915a60, identifier: RM46702
2026-03-27 20:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702
2026-03-27 20:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702
2026-03-27 20:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702 to the API
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:57:49Z',
 'fuel_type': 'petrol',
 'id': 'dc0e1375-1c24-52fe-bef3-32e29d915a60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM46702',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 87002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-27 20:32:39 [auto1.be] INFO: Saving data for RM46702: {'auction_closing_time': 1774717069.0, 'created_time': 1774557088.897698, 'last_price_update_time': 1774643559.320459}
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RM46702') HTTP/1.1" 204 0
2026-03-27 20:32:39 [auto1.be] INFO: Found listing with ID: RJ65357
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ65357%27 HTTP/1.1" 200 None
2026-03-27 20:32:39 [auto1.be] INFO: Scrape type for RJ65357: 2
2026-03-27 20:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2db20589-c661-5e0d-85da-234d458f95b0 with identifier: RJ65357
2026-03-27 20:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2db20589-c661-5e0d-85da-234d458f95b0 with scrape type 2
2026-03-27 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2db20589-c661-5e0d-85da-234d458f95b0 with scrape type 2
2026-03-27 20:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2db20589-c661-5e0d-85da-234d458f95b0, identifier: RJ65357
2026-03-27 20:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC19133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2db20589-c661-5e0d-85da-234d458f95b0 with identifier: RJ65357
2026-03-27 20:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2db20589-c661-5e0d-85da-234d458f95b0 with identifier: RJ65357
2026-03-27 20:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2db20589-c661-5e0d-85da-234d458f95b0 with identifier: RJ65357 to the API
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:37:30Z',
 'fuel_type': 'petrol',
 'id': '2db20589-c661-5e0d-85da-234d458f95b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ65357',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 82516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-14',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ65357%27 HTTP/1.1" 200 None
2026-03-27 20:32:39 [auto1.be] INFO: Saving data for RJ65357: {'auction_closing_time': 1774715850.0, 'created_time': 1773132041.448277, 'last_price_update_time': 1774643559.781202}
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ65357') HTTP/1.1" 204 0
2026-03-27 20:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS48856> (referer: https://www.auto1.com/v1/car-details-view/PS48856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:39 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-27 20:32:39 [auto1.be] INFO: Scrape type for YL67549: 1
2026-03-27 20:32:39 [auto1.be] INFO: Found listing with ID: GE98600
2026-03-27 20:32:39 [auto1.be] INFO: Found listing with ID: UM50519
2026-03-27 20:32:39 [auto1.be] INFO: Found listing with ID: XT89751
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT89751%27 HTTP/1.1" 200 None
2026-03-27 20:32:39 [auto1.be] INFO: Scrape type for XT89751: 0
2026-03-27 20:32:39 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-27 20:32:39 [auto1.be] INFO: Scrape type for WA39171: 2
2026-03-27 20:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171
2026-03-27 20:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 181b9bb8-28ad-519c-a860-e98eb7da57e5 with scrape type 2
2026-03-27 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 181b9bb8-28ad-519c-a860-e98eb7da57e5 with scrape type 2
2026-03-27 20:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 181b9bb8-28ad-519c-a860-e98eb7da57e5, identifier: WA39171
2026-03-27 20:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171
2026-03-27 20:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171
2026-03-27 20:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171 to the API
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:21:23Z',
 'fuel_type': 'diesel',
 'id': '181b9bb8-28ad-519c-a860-e98eb7da57e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA39171',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 142845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-13',
 'seller_name': None,
 'title': 'BMW 6er 620d GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-27 20:32:40 [auto1.be] INFO: Saving data for WA39171: {'auction_closing_time': 1774714883.0, 'created_time': 1774557128.743925, 'last_price_update_time': 1774643560.344467}
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA39171') HTTP/1.1" 204 0
2026-03-27 20:32:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:40 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1659 | hits on page: 40
2026-03-27 20:32:40 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-27 20:32:40 [auto1.be] INFO: Found listing with ID: LC40144
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC40144%27 HTTP/1.1" 200 None
2026-03-27 20:32:40 [auto1.be] INFO: Scrape type for LC40144: 2
2026-03-27 20:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 044b1476-0dca-588c-9ce1-d399690b8020 with identifier: LC40144
2026-03-27 20:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 044b1476-0dca-588c-9ce1-d399690b8020 with scrape type 2
2026-03-27 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 044b1476-0dca-588c-9ce1-d399690b8020 with scrape type 2
2026-03-27 20:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 044b1476-0dca-588c-9ce1-d399690b8020, identifier: LC40144
2026-03-27 20:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 044b1476-0dca-588c-9ce1-d399690b8020 with identifier: LC40144
2026-03-27 20:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 044b1476-0dca-588c-9ce1-d399690b8020 with identifier: LC40144
2026-03-27 20:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 044b1476-0dca-588c-9ce1-d399690b8020 with identifier: LC40144 to the API
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 262,
 'expiration_date': '2026-03-28T16:33:36Z',
 'fuel_type': 'diesel',
 'id': '044b1476-0dca-588c-9ce1-d399690b8020',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC40144',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 279801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-06',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC40144%27 HTTP/1.1" 200 None
2026-03-27 20:32:40 [auto1.be] INFO: Saving data for LC40144: {'auction_closing_time': 1774715616.0, 'created_time': 1773132104.600268, 'last_price_update_time': 1774643560.740512}
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LC40144') HTTP/1.1" 204 0
2026-03-27 20:32:40 [auto1.be] INFO: Found listing with ID: DZ47511
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ47511%27 HTTP/1.1" 200 None
2026-03-27 20:32:40 [auto1.be] INFO: Scrape type for DZ47511: 0
2026-03-27 20:32:40 [auto1.be] INFO: Found listing with ID: PR67057
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR67057%27 HTTP/1.1" 200 None
2026-03-27 20:32:40 [auto1.be] INFO: Scrape type for PR67057: 2
2026-03-27 20:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e868507e-a392-50df-ba69-5c13f9f40aca with identifier: PR67057
2026-03-27 20:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e868507e-a392-50df-ba69-5c13f9f40aca with scrape type 2
2026-03-27 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e868507e-a392-50df-ba69-5c13f9f40aca with scrape type 2
2026-03-27 20:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e868507e-a392-50df-ba69-5c13f9f40aca, identifier: PR67057
2026-03-27 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM84060/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b91a931-1152-52ee-8282-c5cd69ca2aff with identifier: PS48856
2026-03-27 20:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b91a931-1152-52ee-8282-c5cd69ca2aff with scrape type 1
2026-03-27 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b91a931-1152-52ee-8282-c5cd69ca2aff
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc8%252Fe5c830faca5a52fa1b35e2d499032803%252Fpa%252FPS48856_95c3949ffac6e6582deb8a512fbdb48a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_95c3949ffac6e6582deb8a512fbdb48a.jpg already downloaded
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc8%252Fe5c830faca5a52fa1b35e2d499032803%252Fpa%252FPS48856_84d805bb6b91b6c3759d9bfb5d225b14.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_84d805bb6b91b6c3759d9bfb5d225b14.jpg already downloaded
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc8%252Fe5c830faca5a52fa1b35e2d499032803%252Fpa%252FPS48856_b6888e565095d42bd5ca31e66cfd73b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_b6888e565095d42bd5ca31e66cfd73b8.jpg already downloaded
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc8%252Fe5c830faca5a52fa1b35e2d499032803%252Fpa%252FPS48856_e23d98e8540f73b6ca125a3c9cecd045.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_e23d98e8540f73b6ca125a3c9cecd045.jpg already downloaded
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc8%252Fe5c830faca5a52fa1b35e2d499032803%252Fpa%252FPS48856_7b4fd6a3db98ed13cc6b32a6c546ae0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_7b4fd6a3db98ed13cc6b32a6c546ae0a.jpg already downloaded
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc8%252Fe5c830faca5a52fa1b35e2d499032803%252Fpa%252FPS48856_979f931be7acd79aece57f5011fd07ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_979f931be7acd79aece57f5011fd07ba.jpg already downloaded
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc8%252Fe5c830faca5a52fa1b35e2d499032803%252Fpa%252FPS48856_cb9b280e81c07e83d906c9e8f663e8bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_cb9b280e81c07e83d906c9e8f663e8bf.jpg already downloaded
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc8%252Fe5c830faca5a52fa1b35e2d499032803%252Fpa%252FPS48856_08f5d6a7d97a36e8a232dd9d0f12ca90.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_08f5d6a7d97a36e8a232dd9d0f12ca90.jpg already downloaded
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc8%252Fe5c830faca5a52fa1b35e2d499032803%252Fpa%252FPS48856_dd698b96a93a68c64cbef2c69b0f256d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_dd698b96a93a68c64cbef2c69b0f256d.jpg already downloaded
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc8%252Fe5c830faca5a52fa1b35e2d499032803%252Fpa%252FPS48856_50e5d2472a603cb471e18932cbfc8864.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_50e5d2472a603cb471e18932cbfc8864.jpg already downloaded
2026-03-27 20:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4b91a931-1152-52ee-8282-c5cd69ca2aff, identifier: PS48856
2026-03-27 20:32:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-27 20:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e868507e-a392-50df-ba69-5c13f9f40aca with identifier: PR67057
2026-03-27 20:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e868507e-a392-50df-ba69-5c13f9f40aca with identifier: PR67057
2026-03-27 20:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e868507e-a392-50df-ba69-5c13f9f40aca with identifier: PR67057 to the API
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:27:18Z',
 'fuel_type': 'petrol',
 'id': 'e868507e-a392-50df-ba69-5c13f9f40aca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR67057',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 127148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-26',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2017}
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR67057%27 HTTP/1.1" 200 None
2026-03-27 20:32:41 [auto1.be] INFO: Saving data for PR67057: {'auction_closing_time': 1774715238.0, 'created_time': 1774557133.647621, 'last_price_update_time': 1774643561.425463}
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR67057') HTTP/1.1" 204 0
2026-03-27 20:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4b91a931-1152-52ee-8282-c5cd69ca2aff with identifier: PS48856
2026-03-27 20:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4b91a931-1152-52ee-8282-c5cd69ca2aff with identifier: PS48856
2026-03-27 20:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4b91a931-1152-52ee-8282-c5cd69ca2aff with identifier: PS48856 to the API
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PS48856>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:40Z',
 'fuel_type': 'diesel',
 'id': '4b91a931-1152-52ee-8282-c5cd69ca2aff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS48856',
 'listing': 'auction',
 'location': 'BE, Herk-de-Stad',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 285455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_95c3949ffac6e6582deb8a512fbdb48a.jpg',
                'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_84d805bb6b91b6c3759d9bfb5d225b14.jpg',
                'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_b6888e565095d42bd5ca31e66cfd73b8.jpg',
                'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_e23d98e8540f73b6ca125a3c9cecd045.jpg',
                'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_7b4fd6a3db98ed13cc6b32a6c546ae0a.jpg',
                'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_979f931be7acd79aece57f5011fd07ba.jpg',
                'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_cb9b280e81c07e83d906c9e8f663e8bf.jpg',
                'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_08f5d6a7d97a36e8a232dd9d0f12ca90.jpg',
                'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_dd698b96a93a68c64cbef2c69b0f256d.jpg',
                'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_50e5d2472a603cb471e18932cbfc8864.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b91a931-1152-52ee-8282-c5cd69ca2aff/4b91a931-1152-52ee-8282-c5cd69ca2aff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_95c3949ffac6e6582deb8a512fbdb48a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b91a931-1152-52ee-8282-c5cd69ca2aff/4b91a931-1152-52ee-8282-c5cd69ca2aff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_84d805bb6b91b6c3759d9bfb5d225b14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b91a931-1152-52ee-8282-c5cd69ca2aff/4b91a931-1152-52ee-8282-c5cd69ca2aff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_b6888e565095d42bd5ca31e66cfd73b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b91a931-1152-52ee-8282-c5cd69ca2aff/4b91a931-1152-52ee-8282-c5cd69ca2aff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_e23d98e8540f73b6ca125a3c9cecd045.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b91a931-1152-52ee-8282-c5cd69ca2aff/4b91a931-1152-52ee-8282-c5cd69ca2aff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_7b4fd6a3db98ed13cc6b32a6c546ae0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b91a931-1152-52ee-8282-c5cd69ca2aff/4b91a931-1152-52ee-8282-c5cd69ca2aff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_979f931be7acd79aece57f5011fd07ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b91a931-1152-52ee-8282-c5cd69ca2aff/4b91a931-1152-52ee-8282-c5cd69ca2aff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_cb9b280e81c07e83d906c9e8f663e8bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b91a931-1152-52ee-8282-c5cd69ca2aff/4b91a931-1152-52ee-8282-c5cd69ca2aff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_08f5d6a7d97a36e8a232dd9d0f12ca90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b91a931-1152-52ee-8282-c5cd69ca2aff/4b91a931-1152-52ee-8282-c5cd69ca2aff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_dd698b96a93a68c64cbef2c69b0f256d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b91a931-1152-52ee-8282-c5cd69ca2aff/4b91a931-1152-52ee-8282-c5cd69ca2aff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c8/e5c830faca5a52fa1b35e2d499032803/pa/PS48856_50e5d2472a603cb471e18932cbfc8864.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI lang Trend',
 'transmission': 'manual',
 'trim': 'lang Trend',
 'year': 2010}
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS48856%27 HTTP/1.1" 200 None
2026-03-27 20:32:41 [auto1.be] INFO: Saving data for PS48856: {'created_time': 1774643561.797009, 'last_price_update_time': 1774643561.79702, 'auction_closing_time': 1774715860.0}
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS48856') HTTP/1.1" 204 0
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: UL98118
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL86303%27 HTTP/1.1" 200 None
2026-03-27 20:32:41 [auto1.be] INFO: Scrape type for VL86303: 0
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT02833%27 HTTP/1.1" 200 None
2026-03-27 20:32:41 [auto1.be] INFO: Scrape type for DT02833: 0
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: MG56126
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG56126%27 HTTP/1.1" 200 None
2026-03-27 20:32:41 [auto1.be] INFO: Scrape type for MG56126: 0
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: KW49487
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: JC58807
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: PA01247
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-27 20:32:41 [auto1.be] INFO: Found listing with ID: FJ18494
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ18494%27 HTTP/1.1" 200 None
2026-03-27 20:32:41 [auto1.be] INFO: Scrape type for FJ18494: 2
2026-03-27 20:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a2a3d95-41a8-507e-8e15-e228746ce6b9 with identifier: FJ18494
2026-03-27 20:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a2a3d95-41a8-507e-8e15-e228746ce6b9 with scrape type 2
2026-03-27 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a2a3d95-41a8-507e-8e15-e228746ce6b9 with scrape type 2
2026-03-27 20:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a2a3d95-41a8-507e-8e15-e228746ce6b9, identifier: FJ18494
2026-03-27 20:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a2a3d95-41a8-507e-8e15-e228746ce6b9 with identifier: FJ18494
2026-03-27 20:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a2a3d95-41a8-507e-8e15-e228746ce6b9 with identifier: FJ18494
2026-03-27 20:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a2a3d95-41a8-507e-8e15-e228746ce6b9 with identifier: FJ18494 to the API
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:09:39Z',
 'fuel_type': 'petrol',
 'id': '2a2a3d95-41a8-507e-8e15-e228746ce6b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ18494',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 123868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-15',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2013}
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ18494%27 HTTP/1.1" 200 None
2026-03-27 20:32:42 [auto1.be] INFO: Saving data for FJ18494: {'auction_closing_time': 1774714179.0, 'created_time': 1773693404.917937, 'last_price_update_time': 1774643562.278555}
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ18494') HTTP/1.1" 204 0
2026-03-27 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU67376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:42 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-27 20:32:42 [auto1.be] INFO: Scrape type for LE69229: 0
2026-03-27 20:32:42 [auto1.be] INFO: Found listing with ID: NV96305
2026-03-27 20:32:42 [auto1.be] INFO: Found listing with ID: PN32726
2026-03-27 20:32:42 [auto1.be] INFO: Found listing with ID: MC77569
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC77569%27 HTTP/1.1" 200 None
2026-03-27 20:32:42 [auto1.be] INFO: Scrape type for MC77569: 2
2026-03-27 20:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2abbcb3a-25cf-5827-9bdc-17300c49335f with identifier: MC77569
2026-03-27 20:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2abbcb3a-25cf-5827-9bdc-17300c49335f with scrape type 2
2026-03-27 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2abbcb3a-25cf-5827-9bdc-17300c49335f with scrape type 2
2026-03-27 20:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2abbcb3a-25cf-5827-9bdc-17300c49335f, identifier: MC77569
2026-03-27 20:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2abbcb3a-25cf-5827-9bdc-17300c49335f with identifier: MC77569
2026-03-27 20:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2abbcb3a-25cf-5827-9bdc-17300c49335f with identifier: MC77569
2026-03-27 20:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2abbcb3a-25cf-5827-9bdc-17300c49335f with identifier: MC77569 to the API
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:17:45Z',
 'fuel_type': 'gas',
 'id': '2abbcb3a-25cf-5827-9bdc-17300c49335f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC77569',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Qubo',
 'odometer': 34370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'Fiat Qubo 1.4 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2015}
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC77569%27 HTTP/1.1" 200 None
2026-03-27 20:32:43 [auto1.be] INFO: Saving data for MC77569: {'auction_closing_time': 1774714665.0, 'created_time': 1773136805.24726, 'last_price_update_time': 1774643563.137037}
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MC77569') HTTP/1.1" 204 0
2026-03-27 20:32:43 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-27 20:32:43 [auto1.be] INFO: Found listing with ID: FR29123
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR29123%27 HTTP/1.1" 200 None
2026-03-27 20:32:43 [auto1.be] INFO: Scrape type for FR29123: 0
2026-03-27 20:32:43 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX71438%27 HTTP/1.1" 200 None
2026-03-27 20:32:43 [auto1.be] INFO: Scrape type for TX71438: 2
2026-03-27 20:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 129500a7-4834-5f7e-a9ab-6617061c69c7 with identifier: TX71438
2026-03-27 20:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 129500a7-4834-5f7e-a9ab-6617061c69c7 with scrape type 2
2026-03-27 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 129500a7-4834-5f7e-a9ab-6617061c69c7 with scrape type 2
2026-03-27 20:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 129500a7-4834-5f7e-a9ab-6617061c69c7, identifier: TX71438
2026-03-27 20:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 129500a7-4834-5f7e-a9ab-6617061c69c7 with identifier: TX71438
2026-03-27 20:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 129500a7-4834-5f7e-a9ab-6617061c69c7 with identifier: TX71438
2026-03-27 20:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 129500a7-4834-5f7e-a9ab-6617061c69c7 with identifier: TX71438 to the API
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:18:52Z',
 'fuel_type': 'diesel',
 'id': '129500a7-4834-5f7e-a9ab-6617061c69c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX71438',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 111968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-07',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX71438%27 HTTP/1.1" 200 None
2026-03-27 20:32:43 [auto1.be] INFO: Saving data for TX71438: {'auction_closing_time': 1774714732.0, 'created_time': 1773348935.116575, 'last_price_update_time': 1774643563.561582}
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX71438') HTTP/1.1" 204 0
2026-03-27 20:32:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:43 [auto1.be] INFO: Found listing with ID: VK27252
2026-03-27 20:32:43 [auto1.be] INFO: Found listing with ID: ZL06267
2026-03-27 20:32:43 [auto1.be] INFO: Found listing with ID: KY96002
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KY96002%27 HTTP/1.1" 200 None
2026-03-27 20:32:43 [auto1.be] INFO: Scrape type for KY96002: 1
2026-03-27 20:32:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:43 [auto1.be] INFO: Found listing with ID: TY50069
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY50069%27 HTTP/1.1" 200 None
2026-03-27 20:32:43 [auto1.be] INFO: Scrape type for TY50069: 0
2026-03-27 20:32:43 [auto1.be] INFO: Found listing with ID: ZU65660
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU65660%27 HTTP/1.1" 200 None
2026-03-27 20:32:43 [auto1.be] INFO: Scrape type for ZU65660: 0
2026-03-27 20:32:43 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-27 20:32:43 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-27 20:32:43 [auto1.be] INFO: Found listing with ID: LH83403
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH83403%27 HTTP/1.1" 200 None
2026-03-27 20:32:43 [auto1.be] INFO: Scrape type for LH83403: 2
2026-03-27 20:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1c48f9e-f21b-5e50-89aa-2b41487d195b with identifier: LH83403
2026-03-27 20:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1c48f9e-f21b-5e50-89aa-2b41487d195b with scrape type 2
2026-03-27 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1c48f9e-f21b-5e50-89aa-2b41487d195b with scrape type 2
2026-03-27 20:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b1c48f9e-f21b-5e50-89aa-2b41487d195b, identifier: LH83403
2026-03-27 20:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b1c48f9e-f21b-5e50-89aa-2b41487d195b with identifier: LH83403
2026-03-27 20:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b1c48f9e-f21b-5e50-89aa-2b41487d195b with identifier: LH83403
2026-03-27 20:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b1c48f9e-f21b-5e50-89aa-2b41487d195b with identifier: LH83403 to the API
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:44:42Z',
 'fuel_type': 'diesel',
 'id': 'b1c48f9e-f21b-5e50-89aa-2b41487d195b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH83403',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 127748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-26',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi 360',
 'transmission': 'automatic',
 'trim': '360',
 'year': 2017}
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH83403%27 HTTP/1.1" 200 None
2026-03-27 20:32:44 [auto1.be] INFO: Saving data for LH83403: {'auction_closing_time': 1774716282.0, 'created_time': 1773779957.932217, 'last_price_update_time': 1774643564.075467}
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LH83403') HTTP/1.1" 204 0
2026-03-27 20:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: HP77494
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: WV42280
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV42280%27 HTTP/1.1" 200 None
2026-03-27 20:32:44 [auto1.be] INFO: Scrape type for WV42280: 0
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH74025%27 HTTP/1.1" 200 None
2026-03-27 20:32:44 [auto1.be] INFO: Scrape type for XH74025: 0
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: LM10661
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-27 20:32:44 [auto1.be] INFO: Scrape type for DS23322: 0
2026-03-27 20:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL67549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC19133> (referer: https://www.auto1.com/v1/car-details-view/YC19133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:44 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1659 | hits on page: 40
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: WJ73148
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: GA94606
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA94606%27 HTTP/1.1" 200 None
2026-03-27 20:32:44 [auto1.be] INFO: Scrape type for GA94606: 0
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: UD69238
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD69238%27 HTTP/1.1" 200 None
2026-03-27 20:32:44 [auto1.be] INFO: Scrape type for UD69238: 0
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-27 20:32:44 [auto1.be] INFO: Scrape type for UD97693: 0
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-27 20:32:44 [auto1.be] INFO: Scrape type for YG22909: 0
2026-03-27 20:32:44 [auto1.be] INFO: Found listing with ID: PE30752
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE30752%27 HTTP/1.1" 200 None
2026-03-27 20:32:44 [auto1.be] INFO: Scrape type for PE30752: 2
2026-03-27 20:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c829d2c5-94a6-5dcb-bbb7-2054daf6ee22 with identifier: PE30752
2026-03-27 20:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c829d2c5-94a6-5dcb-bbb7-2054daf6ee22 with scrape type 2
2026-03-27 20:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c829d2c5-94a6-5dcb-bbb7-2054daf6ee22 with scrape type 2
2026-03-27 20:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c829d2c5-94a6-5dcb-bbb7-2054daf6ee22, identifier: PE30752
2026-03-27 20:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c829d2c5-94a6-5dcb-bbb7-2054daf6ee22 with identifier: PE30752
2026-03-27 20:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c829d2c5-94a6-5dcb-bbb7-2054daf6ee22 with identifier: PE30752
2026-03-27 20:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c829d2c5-94a6-5dcb-bbb7-2054daf6ee22 with identifier: PE30752 to the API
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:12:17Z',
 'fuel_type': 'diesel',
 'id': 'c829d2c5-94a6-5dcb-bbb7-2054daf6ee22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE30752',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 127241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-26',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 2.0 JTDM Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2015}
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE30752%27 HTTP/1.1" 200 None
2026-03-27 20:32:44 [auto1.be] INFO: Saving data for PE30752: {'auction_closing_time': 1774714337.0, 'created_time': 1773301770.971018, 'last_price_update_time': 1774643564.941214}
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PE30752') HTTP/1.1" 204 0
2026-03-27 20:32:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:45 [auto1.be] INFO: Found listing with ID: LX91228
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX91228%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [auto1.be] INFO: Scrape type for LX91228: 2
2026-03-27 20:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 482740ad-e781-5022-844a-6a96a75dfd5d with identifier: LX91228
2026-03-27 20:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 482740ad-e781-5022-844a-6a96a75dfd5d with scrape type 2
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 482740ad-e781-5022-844a-6a96a75dfd5d with scrape type 2
2026-03-27 20:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 482740ad-e781-5022-844a-6a96a75dfd5d, identifier: LX91228
2026-03-27 20:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 482740ad-e781-5022-844a-6a96a75dfd5d with identifier: LX91228
2026-03-27 20:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 482740ad-e781-5022-844a-6a96a75dfd5d with identifier: LX91228
2026-03-27 20:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 482740ad-e781-5022-844a-6a96a75dfd5d with identifier: LX91228 to the API
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:52:10Z',
 'fuel_type': 'petrol',
 'id': '482740ad-e781-5022-844a-6a96a75dfd5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX91228',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Cascada',
 'odometer': 101799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': None,
 'title': 'Opel Cascada 1.6 SIDI Turbo Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2019}
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX91228%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [auto1.be] INFO: Saving data for LX91228: {'auction_closing_time': 1774716730.0, 'created_time': 1773909053.870871, 'last_price_update_time': 1774643565.442201}
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LX91228') HTTP/1.1" 204 0
2026-03-27 20:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eac1018-ac2e-5ec3-a559-66f2f5e9328d with identifier: YC19133
2026-03-27 20:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eac1018-ac2e-5ec3-a559-66f2f5e9328d with scrape type 1
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5eac1018-ac2e-5ec3-a559-66f2f5e9328d
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d3ef01a57862017c980e485149f61%252Fpa%252FYC19133_ff9d377a7b7a88fa76ac5910bf38fcb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_ff9d377a7b7a88fa76ac5910bf38fcb4.jpg already downloaded
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d3ef01a57862017c980e485149f61%252Fpa%252FYC19133_269e550f151dda6f49e22440ce644d0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_269e550f151dda6f49e22440ce644d0f.jpg already downloaded
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d3ef01a57862017c980e485149f61%252Fpa%252FYC19133_b5155e3a87741acb1929b6c051d01879.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_b5155e3a87741acb1929b6c051d01879.jpg already downloaded
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d3ef01a57862017c980e485149f61%252Fpa%252FYC19133_8b5d20fb42ccaee52b566b24537a7c97.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_8b5d20fb42ccaee52b566b24537a7c97.jpg already downloaded
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d3ef01a57862017c980e485149f61%252Fpa%252FYC19133_bf6509e0d12f0437367c8eb7262fc8e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_bf6509e0d12f0437367c8eb7262fc8e5.jpg already downloaded
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d3ef01a57862017c980e485149f61%252Fpa%252FYC19133_5f8b7b451d13fd667d2cae9ae5cb21ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_5f8b7b451d13fd667d2cae9ae5cb21ab.jpg already downloaded
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d3ef01a57862017c980e485149f61%252Fpa%252FYC19133_4b90b8d61c0f259128e933dd7f8071eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_4b90b8d61c0f259128e933dd7f8071eb.jpg already downloaded
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d3ef01a57862017c980e485149f61%252Fpa%252FYC19133_4394d223b103cddee80d83ed901c6ea7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_4394d223b103cddee80d83ed901c6ea7.jpg already downloaded
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d3ef01a57862017c980e485149f61%252Fpa%252FYC19133_b5f5d8e103833969c62a5b837a99accc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_b5f5d8e103833969c62a5b837a99accc.jpg already downloaded
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d3ef01a57862017c980e485149f61%252Fpa%252FYC19133_331a96e719ee0858b08ce65a022e2339.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_331a96e719ee0858b08ce65a022e2339.jpg already downloaded
2026-03-27 20:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5eac1018-ac2e-5ec3-a559-66f2f5e9328d, identifier: YC19133
2026-03-27 20:32:45 [auto1.be] INFO: Found listing with ID: NN41814
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN41814%27 HTTP/1.1" 200 None
2026-03-27 20:32:45 [auto1.be] INFO: Scrape type for NN41814: 2
2026-03-27 20:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681f1497-998e-5894-851b-6f77ad7e3e86 with identifier: NN41814
2026-03-27 20:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681f1497-998e-5894-851b-6f77ad7e3e86 with scrape type 2
2026-03-27 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 681f1497-998e-5894-851b-6f77ad7e3e86 with scrape type 2
2026-03-27 20:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 681f1497-998e-5894-851b-6f77ad7e3e86, identifier: NN41814
2026-03-27 20:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5eac1018-ac2e-5ec3-a559-66f2f5e9328d with identifier: YC19133
2026-03-27 20:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5eac1018-ac2e-5ec3-a559-66f2f5e9328d with identifier: YC19133
2026-03-27 20:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5eac1018-ac2e-5ec3-a559-66f2f5e9328d with identifier: YC19133 to the API
2026-03-27 20:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YC19133>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:31:08Z',
 'fuel_type': 'hybrid',
 'id': '5eac1018-ac2e-5ec3-a559-66f2f5e9328d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC19133',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 36779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_ff9d377a7b7a88fa76ac5910bf38fcb4.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_269e550f151dda6f49e22440ce644d0f.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_b5155e3a87741acb1929b6c051d01879.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_8b5d20fb42ccaee52b566b24537a7c97.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_bf6509e0d12f0437367c8eb7262fc8e5.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_5f8b7b451d13fd667d2cae9ae5cb21ab.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_4b90b8d61c0f259128e933dd7f8071eb.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_4394d223b103cddee80d83ed901c6ea7.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_b5f5d8e103833969c62a5b837a99accc.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_331a96e719ee0858b08ce65a022e2339.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eac1018-ac2e-5ec3-a559-66f2f5e9328d/5eac1018-ac2e-5ec3-a559-66f2f5e9328d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_ff9d377a7b7a88fa76ac5910bf38fcb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eac1018-ac2e-5ec3-a559-66f2f5e9328d/5eac1018-ac2e-5ec3-a559-66f2f5e9328d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_269e550f151dda6f49e22440ce644d0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eac1018-ac2e-5ec3-a559-66f2f5e9328d/5eac1018-ac2e-5ec3-a559-66f2f5e9328d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_b5155e3a87741acb1929b6c051d01879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eac1018-ac2e-5ec3-a559-66f2f5e9328d/5eac1018-ac2e-5ec3-a559-66f2f5e9328d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_8b5d20fb42ccaee52b566b24537a7c97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eac1018-ac2e-5ec3-a559-66f2f5e9328d/5eac1018-ac2e-5ec3-a559-66f2f5e9328d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_bf6509e0d12f0437367c8eb7262fc8e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eac1018-ac2e-5ec3-a559-66f2f5e9328d/5eac1018-ac2e-5ec3-a559-66f2f5e9328d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_5f8b7b451d13fd667d2cae9ae5cb21ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eac1018-ac2e-5ec3-a559-66f2f5e9328d/5eac1018-ac2e-5ec3-a559-66f2f5e9328d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_4b90b8d61c0f259128e933dd7f8071eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eac1018-ac2e-5ec3-a559-66f2f5e9328d/5eac1018-ac2e-5ec3-a559-66f2f5e9328d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_4394d223b103cddee80d83ed901c6ea7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eac1018-ac2e-5ec3-a559-66f2f5e9328d/5eac1018-ac2e-5ec3-a559-66f2f5e9328d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_b5f5d8e103833969c62a5b837a99accc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eac1018-ac2e-5ec3-a559-66f2f5e9328d/5eac1018-ac2e-5ec3-a559-66f2f5e9328d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d3ef01a57862017c980e485149f61/pa/YC19133_331a96e719ee0858b08ce65a022e2339.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2022}
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC19133%27 HTTP/1.1" 200 None
2026-03-27 20:32:46 [auto1.be] INFO: Saving data for YC19133: {'created_time': 1774643566.152707, 'last_price_update_time': 1774643566.152717, 'auction_closing_time': 1774715468.0}
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YC19133') HTTP/1.1" 204 0
2026-03-27 20:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 681f1497-998e-5894-851b-6f77ad7e3e86 with identifier: NN41814
2026-03-27 20:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 681f1497-998e-5894-851b-6f77ad7e3e86 with identifier: NN41814
2026-03-27 20:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 681f1497-998e-5894-851b-6f77ad7e3e86 with identifier: NN41814 to the API
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:51:02Z',
 'fuel_type': 'diesel',
 'id': '681f1497-998e-5894-851b-6f77ad7e3e86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN41814',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 80885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-06',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN41814%27 HTTP/1.1" 200 None
2026-03-27 20:32:46 [auto1.be] INFO: Saving data for NN41814: {'auction_closing_time': 1774716662.0, 'created_time': 1773136163.140209, 'last_price_update_time': 1774643566.463141}
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN41814') HTTP/1.1" 204 0
2026-03-27 20:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM84060> (referer: https://www.auto1.com/v1/car-details-view/NM84060/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:46 [auto1.be] INFO: Found listing with ID: UB59400
2026-03-27 20:32:46 [auto1.be] INFO: Found listing with ID: JW19159
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW19159%27 HTTP/1.1" 200 None
2026-03-27 20:32:46 [auto1.be] INFO: Scrape type for JW19159: 1
2026-03-27 20:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY96002/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU67376> (referer: https://www.auto1.com/v1/car-details-view/VU67376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:46 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-27 20:32:46 [auto1.be] INFO: Found listing with ID: XH16695
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH16695%27 HTTP/1.1" 200 None
2026-03-27 20:32:46 [auto1.be] INFO: Scrape type for XH16695: 2
2026-03-27 20:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe27a13-4d98-5087-8a21-431d2f8e77cc with identifier: XH16695
2026-03-27 20:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe27a13-4d98-5087-8a21-431d2f8e77cc with scrape type 2
2026-03-27 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe27a13-4d98-5087-8a21-431d2f8e77cc with scrape type 2
2026-03-27 20:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cfe27a13-4d98-5087-8a21-431d2f8e77cc, identifier: XH16695
2026-03-27 20:32:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cfe27a13-4d98-5087-8a21-431d2f8e77cc with identifier: XH16695
2026-03-27 20:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cfe27a13-4d98-5087-8a21-431d2f8e77cc with identifier: XH16695
2026-03-27 20:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cfe27a13-4d98-5087-8a21-431d2f8e77cc with identifier: XH16695 to the API
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 341,
 'expiration_date': '2026-03-28T16:48:29Z',
 'fuel_type': 'hybrid',
 'id': 'cfe27a13-4d98-5087-8a21-431d2f8e77cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH16695',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 164735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T6 Plug-in Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2020}
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH16695%27 HTTP/1.1" 200 None
2026-03-27 20:32:46 [auto1.be] INFO: Saving data for XH16695: {'auction_closing_time': 1774716509.0, 'created_time': 1774470982.293689, 'last_price_update_time': 1774643566.865285}
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH16695') HTTP/1.1" 204 0
2026-03-27 20:32:46 [auto1.be] INFO: Found listing with ID: EY06710
2026-03-27 20:32:46 [auto1.be] INFO: Found listing with ID: RX67951
2026-03-27 20:32:46 [auto1.be] INFO: Found listing with ID: RB45450
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB45450%27 HTTP/1.1" 200 None
2026-03-27 20:32:46 [auto1.be] INFO: Scrape type for RB45450: 2
2026-03-27 20:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 737e0b56-ec9e-5d08-8686-3f7682aaf0b3 with identifier: RB45450
2026-03-27 20:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 737e0b56-ec9e-5d08-8686-3f7682aaf0b3 with scrape type 2
2026-03-27 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 737e0b56-ec9e-5d08-8686-3f7682aaf0b3 with scrape type 2
2026-03-27 20:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 737e0b56-ec9e-5d08-8686-3f7682aaf0b3, identifier: RB45450
2026-03-27 20:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 737e0b56-ec9e-5d08-8686-3f7682aaf0b3 with identifier: RB45450
2026-03-27 20:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 737e0b56-ec9e-5d08-8686-3f7682aaf0b3 with identifier: RB45450
2026-03-27 20:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 737e0b56-ec9e-5d08-8686-3f7682aaf0b3 with identifier: RB45450 to the API
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:51:40Z',
 'fuel_type': 'diesel',
 'id': '737e0b56-ec9e-5d08-8686-3f7682aaf0b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB45450',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 232736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-21',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB45450%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [auto1.be] INFO: Saving data for RB45450: {'auction_closing_time': 1774716700.0, 'created_time': 1773952727.438591, 'last_price_update_time': 1774643567.299306}
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RB45450') HTTP/1.1" 204 0
2026-03-27 20:32:47 [auto1.be] INFO: Found listing with ID: MP38676
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP38676%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [auto1.be] INFO: Scrape type for MP38676: 1
2026-03-27 20:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060
2026-03-27 20:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a630a96-508e-55cb-8691-c0402ec8b828 with scrape type 1
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a630a96-508e-55cb-8691-c0402ec8b828
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F41%252F7741a1cfccd4af998d37498b76641554%252Fpa%252FNM84060_32af7418d3b4a56a72b5a53b9e0d2ea0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_32af7418d3b4a56a72b5a53b9e0d2ea0.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F41%252F7741a1cfccd4af998d37498b76641554%252Fpa%252FNM84060_0663106ab9277b488978829b7ab256fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_0663106ab9277b488978829b7ab256fd.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F41%252F7741a1cfccd4af998d37498b76641554%252Fpa%252FNM84060_518cc360a06baa6ea6cb08675ff9eb8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_518cc360a06baa6ea6cb08675ff9eb8e.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F41%252F7741a1cfccd4af998d37498b76641554%252Fpa%252FNM84060_0adf226241ce13e42046b0e3204d7162.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_0adf226241ce13e42046b0e3204d7162.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F41%252F7741a1cfccd4af998d37498b76641554%252Fpa%252FNM84060_f4a092f7a520b535ff74bec710a47472.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_f4a092f7a520b535ff74bec710a47472.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F41%252F7741a1cfccd4af998d37498b76641554%252Fpa%252FNM84060_b557e842abc4fb48cdd8cd5bc4ceb25b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_b557e842abc4fb48cdd8cd5bc4ceb25b.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F41%252F7741a1cfccd4af998d37498b76641554%252Fpa%252FNM84060_ebe50a41a412d228c36db04e1e942afd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_ebe50a41a412d228c36db04e1e942afd.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F41%252F7741a1cfccd4af998d37498b76641554%252Fpa%252FNM84060_1a45c0ba7535221daf49b235a1722b20.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_1a45c0ba7535221daf49b235a1722b20.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F41%252F7741a1cfccd4af998d37498b76641554%252Fpa%252FNM84060_7f754a1b8154b32d4a5163608c0b1172.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_7f754a1b8154b32d4a5163608c0b1172.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F41%252F7741a1cfccd4af998d37498b76641554%252Fpa%252FNM84060_0855c35ad99392b2713525246122de4d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_0855c35ad99392b2713525246122de4d.jpg already downloaded
2026-03-27 20:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a630a96-508e-55cb-8691-c0402ec8b828, identifier: NM84060
2026-03-27 20:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19a5c318-ae02-5f31-ae2e-2c41725a4ae8 with identifier: VU67376
2026-03-27 20:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19a5c318-ae02-5f31-ae2e-2c41725a4ae8 with scrape type 1
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 19a5c318-ae02-5f31-ae2e-2c41725a4ae8
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F18%252Fcc185949b7b6a4f068bd1c738fdc041a%252Fpa%252FVU67376_9a994cdf38b1c299efa52f8c4bd70b92.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_9a994cdf38b1c299efa52f8c4bd70b92.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F18%252Fcc185949b7b6a4f068bd1c738fdc041a%252Fpa%252FVU67376_7807d3c91066c51b7b4cb52aa93e4d30.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_7807d3c91066c51b7b4cb52aa93e4d30.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F18%252Fcc185949b7b6a4f068bd1c738fdc041a%252Fpa%252FVU67376_8d82670dd68fc8a8318e0b6c54a9294a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_8d82670dd68fc8a8318e0b6c54a9294a.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F18%252Fcc185949b7b6a4f068bd1c738fdc041a%252Fpa%252FVU67376_585be82b4994cf7d04f5dabc2d8ebc14.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_585be82b4994cf7d04f5dabc2d8ebc14.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F18%252Fcc185949b7b6a4f068bd1c738fdc041a%252Fpa%252FVU67376_812744e461618b09041972977eaf1543.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_812744e461618b09041972977eaf1543.jpg already downloaded
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F18%252Fcc185949b7b6a4f068bd1c738fdc041a%252Fpa%252FVU67376_dcfde2566946183cc6fe9d58af0fe139.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_dcfde2566946183cc6fe9d58af0fe139.jpg already downloaded
2026-03-27 20:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 19a5c318-ae02-5f31-ae2e-2c41725a4ae8, identifier: VU67376
2026-03-27 20:32:47 [auto1.be] INFO: Found listing with ID: VA35443
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA35443%27 HTTP/1.1" 200 None
2026-03-27 20:32:47 [auto1.be] INFO: Scrape type for VA35443: 2
2026-03-27 20:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3304014e-b17b-5ed7-81b1-f032590ed92a with identifier: VA35443
2026-03-27 20:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3304014e-b17b-5ed7-81b1-f032590ed92a with scrape type 2
2026-03-27 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3304014e-b17b-5ed7-81b1-f032590ed92a with scrape type 2
2026-03-27 20:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3304014e-b17b-5ed7-81b1-f032590ed92a, identifier: VA35443
2026-03-27 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL67549> (referer: https://www.auto1.com/v1/car-details-view/YL67549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060
2026-03-27 20:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060
2026-03-27 20:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060 to the API
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NM84060>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:59Z',
 'fuel_type': 'diesel',
 'id': '2a630a96-508e-55cb-8691-c0402ec8b828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM84060',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 216122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_32af7418d3b4a56a72b5a53b9e0d2ea0.jpg',
                'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_0663106ab9277b488978829b7ab256fd.jpg',
                'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_518cc360a06baa6ea6cb08675ff9eb8e.jpg',
                'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_0adf226241ce13e42046b0e3204d7162.jpg',
                'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_f4a092f7a520b535ff74bec710a47472.jpg',
                'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_b557e842abc4fb48cdd8cd5bc4ceb25b.jpg',
                'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_ebe50a41a412d228c36db04e1e942afd.jpg',
                'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_1a45c0ba7535221daf49b235a1722b20.jpg',
                'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_7f754a1b8154b32d4a5163608c0b1172.jpg',
                'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_0855c35ad99392b2713525246122de4d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a630a96-508e-55cb-8691-c0402ec8b828/2a630a96-508e-55cb-8691-c0402ec8b828_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_32af7418d3b4a56a72b5a53b9e0d2ea0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a630a96-508e-55cb-8691-c0402ec8b828/2a630a96-508e-55cb-8691-c0402ec8b828_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_0663106ab9277b488978829b7ab256fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a630a96-508e-55cb-8691-c0402ec8b828/2a630a96-508e-55cb-8691-c0402ec8b828_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_518cc360a06baa6ea6cb08675ff9eb8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a630a96-508e-55cb-8691-c0402ec8b828/2a630a96-508e-55cb-8691-c0402ec8b828_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_0adf226241ce13e42046b0e3204d7162.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a630a96-508e-55cb-8691-c0402ec8b828/2a630a96-508e-55cb-8691-c0402ec8b828_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_f4a092f7a520b535ff74bec710a47472.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a630a96-508e-55cb-8691-c0402ec8b828/2a630a96-508e-55cb-8691-c0402ec8b828_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_b557e842abc4fb48cdd8cd5bc4ceb25b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a630a96-508e-55cb-8691-c0402ec8b828/2a630a96-508e-55cb-8691-c0402ec8b828_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_ebe50a41a412d228c36db04e1e942afd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a630a96-508e-55cb-8691-c0402ec8b828/2a630a96-508e-55cb-8691-c0402ec8b828_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_1a45c0ba7535221daf49b235a1722b20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a630a96-508e-55cb-8691-c0402ec8b828/2a630a96-508e-55cb-8691-c0402ec8b828_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_7f754a1b8154b32d4a5163608c0b1172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a630a96-508e-55cb-8691-c0402ec8b828/2a630a96-508e-55cb-8691-c0402ec8b828_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/41/7741a1cfccd4af998d37498b76641554/pa/NM84060_0855c35ad99392b2713525246122de4d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V90 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2018}
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-27 20:32:48 [auto1.be] INFO: Saving data for NM84060: {'created_time': 1774643568.237832, 'last_price_update_time': 1774643568.237842, 'auction_closing_time': 1774714619.0}
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NM84060') HTTP/1.1" 204 0
2026-03-27 20:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 19a5c318-ae02-5f31-ae2e-2c41725a4ae8 with identifier: VU67376
2026-03-27 20:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 19a5c318-ae02-5f31-ae2e-2c41725a4ae8 with identifier: VU67376
2026-03-27 20:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 19a5c318-ae02-5f31-ae2e-2c41725a4ae8 with identifier: VU67376 to the API
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VU67376>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:43:57Z',
 'fuel_type': 'petrol',
 'id': '19a5c318-ae02-5f31-ae2e-2c41725a4ae8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU67376',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 92579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_9a994cdf38b1c299efa52f8c4bd70b92.jpg',
                'https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_7807d3c91066c51b7b4cb52aa93e4d30.jpg',
                'https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_8d82670dd68fc8a8318e0b6c54a9294a.jpg',
                'https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_585be82b4994cf7d04f5dabc2d8ebc14.jpg',
                'https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_812744e461618b09041972977eaf1543.jpg',
                'https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_dcfde2566946183cc6fe9d58af0fe139.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a5c318-ae02-5f31-ae2e-2c41725a4ae8/19a5c318-ae02-5f31-ae2e-2c41725a4ae8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_9a994cdf38b1c299efa52f8c4bd70b92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a5c318-ae02-5f31-ae2e-2c41725a4ae8/19a5c318-ae02-5f31-ae2e-2c41725a4ae8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_7807d3c91066c51b7b4cb52aa93e4d30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a5c318-ae02-5f31-ae2e-2c41725a4ae8/19a5c318-ae02-5f31-ae2e-2c41725a4ae8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_8d82670dd68fc8a8318e0b6c54a9294a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a5c318-ae02-5f31-ae2e-2c41725a4ae8/19a5c318-ae02-5f31-ae2e-2c41725a4ae8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_585be82b4994cf7d04f5dabc2d8ebc14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a5c318-ae02-5f31-ae2e-2c41725a4ae8/19a5c318-ae02-5f31-ae2e-2c41725a4ae8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_812744e461618b09041972977eaf1543.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a5c318-ae02-5f31-ae2e-2c41725a4ae8/19a5c318-ae02-5f31-ae2e-2c41725a4ae8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/18/cc185949b7b6a4f068bd1c738fdc041a/pa/VU67376_dcfde2566946183cc6fe9d58af0fe139.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2014}
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU67376%27 HTTP/1.1" 200 None
2026-03-27 20:32:48 [auto1.be] INFO: Saving data for VU67376: {'created_time': 1774643568.621243, 'last_price_update_time': 1774643568.621252, 'auction_closing_time': 1774716237.0}
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VU67376') HTTP/1.1" 204 0
2026-03-27 20:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3304014e-b17b-5ed7-81b1-f032590ed92a with identifier: VA35443
2026-03-27 20:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3304014e-b17b-5ed7-81b1-f032590ed92a with identifier: VA35443
2026-03-27 20:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3304014e-b17b-5ed7-81b1-f032590ed92a with identifier: VA35443 to the API
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:55:25Z',
 'fuel_type': 'diesel',
 'id': '3304014e-b17b-5ed7-81b1-f032590ed92a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA35443',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 258486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-21',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA35443%27 HTTP/1.1" 200 None
2026-03-27 20:32:48 [auto1.be] INFO: Saving data for VA35443: {'auction_closing_time': 1774716925.0, 'created_time': 1773349216.907446, 'last_price_update_time': 1774643568.927454}
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA35443') HTTP/1.1" 204 0
2026-03-27 20:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:48 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-27 20:32:48 [auto1.be] INFO: Scrape type for UB84592: 2
2026-03-27 20:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592
2026-03-27 20:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 516bc0b6-5c82-5f80-9750-93a36a823b57 with scrape type 2
2026-03-27 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 516bc0b6-5c82-5f80-9750-93a36a823b57 with scrape type 2
2026-03-27 20:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 516bc0b6-5c82-5f80-9750-93a36a823b57, identifier: UB84592
2026-03-27 20:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592
2026-03-27 20:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592
2026-03-27 20:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592 to the API
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:17:25Z',
 'fuel_type': 'diesel',
 'id': '516bc0b6-5c82-5f80-9750-93a36a823b57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB84592',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 207383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-10',
 'seller_name': None,
 'title': 'Mazda 2 1.4 Diesel CD Elegance',
 'transmission': 'manual',
 'trim': 'CD Elegance',
 'year': 2010}
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [auto1.be] INFO: Saving data for UB84592: {'auction_closing_time': 1774714645.0, 'created_time': 1773923215.556997, 'last_price_update_time': 1774643569.368441}
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UB84592') HTTP/1.1" 204 0
2026-03-27 20:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549
2026-03-27 20:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871fb17f-43c0-51df-83fe-8fd9f9a98293 with scrape type 1
2026-03-27 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 871fb17f-43c0-51df-83fe-8fd9f9a98293
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fef%252F4def6f342cfc20807a269cff726b02b1%252Fpa%252FYL67549_c0c9286383349c3a78bfec975f82f5ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_c0c9286383349c3a78bfec975f82f5ed.jpg already downloaded
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fef%252F4def6f342cfc20807a269cff726b02b1%252Fpa%252FYL67549_e2e659d6a12b9b649a7e47ece24b8ad9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_e2e659d6a12b9b649a7e47ece24b8ad9.jpg already downloaded
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fef%252F4def6f342cfc20807a269cff726b02b1%252Fpa%252FYL67549_5ae5396d6c0468fc595b9c29948e9dc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_5ae5396d6c0468fc595b9c29948e9dc3.jpg already downloaded
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fef%252F4def6f342cfc20807a269cff726b02b1%252Fpa%252FYL67549_75ec0a4eb7e74622212c8765e5cbd9b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_75ec0a4eb7e74622212c8765e5cbd9b3.jpg already downloaded
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fef%252F4def6f342cfc20807a269cff726b02b1%252Fpa%252FYL67549_37f8d7a2dff041a453617594bea719d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_37f8d7a2dff041a453617594bea719d9.jpg already downloaded
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fef%252F4def6f342cfc20807a269cff726b02b1%252Fpa%252FYL67549_60693272b96166231d3602857df00193.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_60693272b96166231d3602857df00193.jpg already downloaded
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fef%252F4def6f342cfc20807a269cff726b02b1%252Fpa%252FYL67549_bc2a5fa0da2a3e86dd25c2b43831b99f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_bc2a5fa0da2a3e86dd25c2b43831b99f.jpg already downloaded
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fef%252F4def6f342cfc20807a269cff726b02b1%252Fpa%252FYL67549_730390b4f95fff58404c153a03c5855b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_730390b4f95fff58404c153a03c5855b.jpg already downloaded
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fef%252F4def6f342cfc20807a269cff726b02b1%252Fpa%252FYL67549_af065508dec7e9684a55e849b3622cd1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_af065508dec7e9684a55e849b3622cd1.jpg already downloaded
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fef%252F4def6f342cfc20807a269cff726b02b1%252Fpa%252FYL67549_20fa1a2753e6cf96025178913f30a54c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_20fa1a2753e6cf96025178913f30a54c.jpg already downloaded
2026-03-27 20:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 871fb17f-43c0-51df-83fe-8fd9f9a98293, identifier: YL67549
2026-03-27 20:32:49 [auto1.be] INFO: Found listing with ID: AT11769
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT11769%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [auto1.be] INFO: Scrape type for AT11769: 1
2026-03-27 20:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549
2026-03-27 20:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549
2026-03-27 20:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549 to the API
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL67549>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:53:31Z',
 'fuel_type': 'petrol',
 'id': '871fb17f-43c0-51df-83fe-8fd9f9a98293',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL67549',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 214666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_c0c9286383349c3a78bfec975f82f5ed.jpg',
                'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_e2e659d6a12b9b649a7e47ece24b8ad9.jpg',
                'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_5ae5396d6c0468fc595b9c29948e9dc3.jpg',
                'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_75ec0a4eb7e74622212c8765e5cbd9b3.jpg',
                'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_37f8d7a2dff041a453617594bea719d9.jpg',
                'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_60693272b96166231d3602857df00193.jpg',
                'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_bc2a5fa0da2a3e86dd25c2b43831b99f.jpg',
                'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_730390b4f95fff58404c153a03c5855b.jpg',
                'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_af065508dec7e9684a55e849b3622cd1.jpg',
                'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_20fa1a2753e6cf96025178913f30a54c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871fb17f-43c0-51df-83fe-8fd9f9a98293/871fb17f-43c0-51df-83fe-8fd9f9a98293_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_c0c9286383349c3a78bfec975f82f5ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871fb17f-43c0-51df-83fe-8fd9f9a98293/871fb17f-43c0-51df-83fe-8fd9f9a98293_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_e2e659d6a12b9b649a7e47ece24b8ad9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871fb17f-43c0-51df-83fe-8fd9f9a98293/871fb17f-43c0-51df-83fe-8fd9f9a98293_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_5ae5396d6c0468fc595b9c29948e9dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871fb17f-43c0-51df-83fe-8fd9f9a98293/871fb17f-43c0-51df-83fe-8fd9f9a98293_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_75ec0a4eb7e74622212c8765e5cbd9b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871fb17f-43c0-51df-83fe-8fd9f9a98293/871fb17f-43c0-51df-83fe-8fd9f9a98293_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_37f8d7a2dff041a453617594bea719d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871fb17f-43c0-51df-83fe-8fd9f9a98293/871fb17f-43c0-51df-83fe-8fd9f9a98293_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_60693272b96166231d3602857df00193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871fb17f-43c0-51df-83fe-8fd9f9a98293/871fb17f-43c0-51df-83fe-8fd9f9a98293_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_bc2a5fa0da2a3e86dd25c2b43831b99f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871fb17f-43c0-51df-83fe-8fd9f9a98293/871fb17f-43c0-51df-83fe-8fd9f9a98293_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_730390b4f95fff58404c153a03c5855b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871fb17f-43c0-51df-83fe-8fd9f9a98293/871fb17f-43c0-51df-83fe-8fd9f9a98293_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_af065508dec7e9684a55e849b3622cd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871fb17f-43c0-51df-83fe-8fd9f9a98293/871fb17f-43c0-51df-83fe-8fd9f9a98293_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/ef/4def6f342cfc20807a269cff726b02b1/pa/YL67549_20fa1a2753e6cf96025178913f30a54c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2012}
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [auto1.be] INFO: Saving data for YL67549: {'created_time': 1774643569.947744, 'last_price_update_time': 1774643569.947754, 'auction_closing_time': 1774716811.0}
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YL67549') HTTP/1.1" 204 0
2026-03-27 20:32:49 [auto1.be] INFO: Found listing with ID: ZM98751
2026-03-27 20:32:49 [auto1.be] INFO: Found listing with ID: TA16395
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA16395%27 HTTP/1.1" 200 None
2026-03-27 20:32:49 [auto1.be] INFO: Scrape type for TA16395: 1
2026-03-27 20:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:49 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1659 | hits on page: 40
2026-03-27 20:32:49 [auto1.be] INFO: Found listing with ID: YU29895
2026-03-27 20:32:49 [auto1.be] INFO: Found listing with ID: BD79780
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD79780%27 HTTP/1.1" 200 None
2026-03-27 20:32:50 [auto1.be] INFO: Scrape type for BD79780: 1
2026-03-27 20:32:50 [auto1.be] INFO: Found listing with ID: ED08551
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED08551%27 HTTP/1.1" 200 None
2026-03-27 20:32:50 [auto1.be] INFO: Scrape type for ED08551: 2
2026-03-27 20:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91e84c48-b680-57d4-8ed4-425214a4cbe6 with identifier: ED08551
2026-03-27 20:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91e84c48-b680-57d4-8ed4-425214a4cbe6 with scrape type 2
2026-03-27 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91e84c48-b680-57d4-8ed4-425214a4cbe6 with scrape type 2
2026-03-27 20:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 91e84c48-b680-57d4-8ed4-425214a4cbe6, identifier: ED08551
2026-03-27 20:32:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 91e84c48-b680-57d4-8ed4-425214a4cbe6 with identifier: ED08551
2026-03-27 20:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 91e84c48-b680-57d4-8ed4-425214a4cbe6 with identifier: ED08551
2026-03-27 20:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 91e84c48-b680-57d4-8ed4-425214a4cbe6 with identifier: ED08551 to the API
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:04:05Z',
 'fuel_type': 'diesel',
 'id': '91e84c48-b680-57d4-8ed4-425214a4cbe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED08551',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 441368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-13',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2005}
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED08551%27 HTTP/1.1" 200 None
2026-03-27 20:32:50 [auto1.be] INFO: Saving data for ED08551: {'auction_closing_time': 1774713845.0, 'created_time': 1774471358.911059, 'last_price_update_time': 1774643570.376695}
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED08551') HTTP/1.1" 204 0
2026-03-27 20:32:50 [auto1.be] INFO: Found listing with ID: WW25551
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW25551%27 HTTP/1.1" 200 None
2026-03-27 20:32:50 [auto1.be] INFO: Scrape type for WW25551: 1
2026-03-27 20:32:50 [auto1.be] INFO: Found listing with ID: UL77551
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL77551%27 HTTP/1.1" 200 None
2026-03-27 20:32:50 [auto1.be] INFO: Scrape type for UL77551: 2
2026-03-27 20:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffcc1b2a-4d18-5aed-a327-c17cd8a5c2eb with identifier: UL77551
2026-03-27 20:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffcc1b2a-4d18-5aed-a327-c17cd8a5c2eb with scrape type 2
2026-03-27 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffcc1b2a-4d18-5aed-a327-c17cd8a5c2eb with scrape type 2
2026-03-27 20:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ffcc1b2a-4d18-5aed-a327-c17cd8a5c2eb, identifier: UL77551
2026-03-27 20:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ffcc1b2a-4d18-5aed-a327-c17cd8a5c2eb with identifier: UL77551
2026-03-27 20:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ffcc1b2a-4d18-5aed-a327-c17cd8a5c2eb with identifier: UL77551
2026-03-27 20:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ffcc1b2a-4d18-5aed-a327-c17cd8a5c2eb with identifier: UL77551 to the API
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:40:59Z',
 'fuel_type': 'petrol',
 'id': 'ffcc1b2a-4d18-5aed-a327-c17cd8a5c2eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL77551',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 100503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-15',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL77551%27 HTTP/1.1" 200 None
2026-03-27 20:32:50 [auto1.be] INFO: Saving data for UL77551: {'auction_closing_time': 1774716059.0, 'created_time': 1774471326.137898, 'last_price_update_time': 1774643570.765383}
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UL77551') HTTP/1.1" 204 0
2026-03-27 20:32:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:50 [auto1.be] INFO: Found listing with ID: PC47788
2026-03-27 20:32:50 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-27 20:32:50 [auto1.be] INFO: Scrape type for PC06950: 1
2026-03-27 20:32:50 [auto1.be] INFO: Found listing with ID: UV66357
2026-03-27 20:32:50 [auto1.be] INFO: Found listing with ID: PL62845
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL62845%27 HTTP/1.1" 200 None
2026-03-27 20:32:50 [auto1.be] INFO: Scrape type for PL62845: 2
2026-03-27 20:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 192ed6ff-54f7-561e-bfe8-493b3ef1443f with identifier: PL62845
2026-03-27 20:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 192ed6ff-54f7-561e-bfe8-493b3ef1443f with scrape type 2
2026-03-27 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 192ed6ff-54f7-561e-bfe8-493b3ef1443f with scrape type 2
2026-03-27 20:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 192ed6ff-54f7-561e-bfe8-493b3ef1443f, identifier: PL62845
2026-03-27 20:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 192ed6ff-54f7-561e-bfe8-493b3ef1443f with identifier: PL62845
2026-03-27 20:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 192ed6ff-54f7-561e-bfe8-493b3ef1443f with identifier: PL62845
2026-03-27 20:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 192ed6ff-54f7-561e-bfe8-493b3ef1443f with identifier: PL62845 to the API
2026-03-27 20:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:44:59Z',
 'fuel_type': 'diesel',
 'id': '192ed6ff-54f7-561e-bfe8-493b3ef1443f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL62845',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 210608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL62845%27 HTTP/1.1" 200 None
2026-03-27 20:32:51 [auto1.be] INFO: Saving data for PL62845: {'auction_closing_time': 1774716299.0, 'created_time': 1774471301.688815, 'last_price_update_time': 1774643571.174689}
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PL62845') HTTP/1.1" 204 0
2026-03-27 20:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:51 [auto1.be] INFO: Found listing with ID: XJ17204
2026-03-27 20:32:51 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-27 20:32:51 [auto1.be] INFO: Scrape type for WT61211: 2
2026-03-27 20:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211
2026-03-27 20:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30daaf8d-606c-5ac5-8040-d105e29dfbfc with scrape type 2
2026-03-27 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30daaf8d-606c-5ac5-8040-d105e29dfbfc with scrape type 2
2026-03-27 20:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30daaf8d-606c-5ac5-8040-d105e29dfbfc, identifier: WT61211
2026-03-27 20:32:51 [auto1.be] INFO: Found listing with ID: DD15930
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD15930%27 HTTP/1.1" 200 None
2026-03-27 20:32:51 [auto1.be] INFO: Scrape type for DD15930: 2
2026-03-27 20:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4603daf7-6193-5c3a-9262-730aafb88bca with identifier: DD15930
2026-03-27 20:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4603daf7-6193-5c3a-9262-730aafb88bca with scrape type 2
2026-03-27 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4603daf7-6193-5c3a-9262-730aafb88bca with scrape type 2
2026-03-27 20:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4603daf7-6193-5c3a-9262-730aafb88bca, identifier: DD15930
2026-03-27 20:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211
2026-03-27 20:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211
2026-03-27 20:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211 to the API
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:05:37Z',
 'fuel_type': 'diesel',
 'id': '30daaf8d-606c-5ac5-8040-d105e29dfbfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT61211',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 173096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-19',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-27 20:32:51 [auto1.be] INFO: Saving data for WT61211: {'auction_closing_time': 1774713937.0, 'created_time': 1773301688.620937, 'last_price_update_time': 1774643571.729467}
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WT61211') HTTP/1.1" 204 0
2026-03-27 20:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4603daf7-6193-5c3a-9262-730aafb88bca with identifier: DD15930
2026-03-27 20:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4603daf7-6193-5c3a-9262-730aafb88bca with identifier: DD15930
2026-03-27 20:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4603daf7-6193-5c3a-9262-730aafb88bca with identifier: DD15930 to the API
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:28:40Z',
 'fuel_type': 'petrol',
 'id': '4603daf7-6193-5c3a-9262-730aafb88bca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD15930',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 160956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-13',
 'seller_name': None,
 'title': 'BMW 3er 320i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD15930%27 HTTP/1.1" 200 None
2026-03-27 20:32:52 [auto1.be] INFO: Saving data for DD15930: {'auction_closing_time': 1774715320.0, 'created_time': 1774471366.765086, 'last_price_update_time': 1774643572.015913}
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DD15930') HTTP/1.1" 204 0
2026-03-27 20:32:52 [auto1.be] INFO: Found listing with ID: YY54111
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY54111%27 HTTP/1.1" 200 None
2026-03-27 20:32:52 [auto1.be] INFO: Scrape type for YY54111: 1
2026-03-27 20:32:52 [auto1.be] INFO: Found listing with ID: CY27099
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY27099%27 HTTP/1.1" 200 None
2026-03-27 20:32:52 [auto1.be] INFO: Scrape type for CY27099: 2
2026-03-27 20:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58a6dff0-53cf-5dc1-ab01-bb8d15ae62e3 with identifier: CY27099
2026-03-27 20:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58a6dff0-53cf-5dc1-ab01-bb8d15ae62e3 with scrape type 2
2026-03-27 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58a6dff0-53cf-5dc1-ab01-bb8d15ae62e3 with scrape type 2
2026-03-27 20:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58a6dff0-53cf-5dc1-ab01-bb8d15ae62e3, identifier: CY27099
2026-03-27 20:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58a6dff0-53cf-5dc1-ab01-bb8d15ae62e3 with identifier: CY27099
2026-03-27 20:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58a6dff0-53cf-5dc1-ab01-bb8d15ae62e3 with identifier: CY27099
2026-03-27 20:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58a6dff0-53cf-5dc1-ab01-bb8d15ae62e3 with identifier: CY27099 to the API
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:06:23Z',
 'fuel_type': 'diesel',
 'id': '58a6dff0-53cf-5dc1-ab01-bb8d15ae62e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY27099',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 380226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-07-24',
 'seller_name': None,
 'title': 'Audi A4 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 1996}
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY27099%27 HTTP/1.1" 200 None
2026-03-27 20:32:52 [auto1.be] INFO: Saving data for CY27099: {'auction_closing_time': 1774713983.0, 'created_time': 1774471293.466091, 'last_price_update_time': 1774643572.435871}
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CY27099') HTTP/1.1" 204 0
2026-03-27 20:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP38676/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:52 [auto1.be] INFO: Found listing with ID: JX95723
2026-03-27 20:32:52 [auto1.be] INFO: Found listing with ID: JP70611
2026-03-27 20:32:52 [auto1.be] INFO: Found listing with ID: BY20411
2026-03-27 20:32:52 [auto1.be] INFO: Found listing with ID: UK22118
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK22118%27 HTTP/1.1" 200 None
2026-03-27 20:32:52 [auto1.be] INFO: Scrape type for UK22118: 2
2026-03-27 20:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 017ccd51-324c-5687-b400-0dbd8114a051 with identifier: UK22118
2026-03-27 20:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 017ccd51-324c-5687-b400-0dbd8114a051 with scrape type 2
2026-03-27 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 017ccd51-324c-5687-b400-0dbd8114a051 with scrape type 2
2026-03-27 20:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 017ccd51-324c-5687-b400-0dbd8114a051, identifier: UK22118
2026-03-27 20:32:52 [auto1.be] INFO: Found listing with ID: XU96332
2026-03-27 20:32:52 [auto1.be] INFO: Found listing with ID: GS41207
2026-03-27 20:32:52 [auto1.be] INFO: Found listing with ID: RJ05295
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ05295%27 HTTP/1.1" 200 None
2026-03-27 20:32:52 [auto1.be] INFO: Scrape type for RJ05295: 2
2026-03-27 20:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2147fb82-f258-5bf6-8225-7c6a49c43460 with identifier: RJ05295
2026-03-27 20:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2147fb82-f258-5bf6-8225-7c6a49c43460 with scrape type 2
2026-03-27 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2147fb82-f258-5bf6-8225-7c6a49c43460 with scrape type 2
2026-03-27 20:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2147fb82-f258-5bf6-8225-7c6a49c43460, identifier: RJ05295
2026-03-27 20:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY96002> (referer: https://www.auto1.com/v1/car-details-view/KY96002/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 017ccd51-324c-5687-b400-0dbd8114a051 with identifier: UK22118
2026-03-27 20:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 017ccd51-324c-5687-b400-0dbd8114a051 with identifier: UK22118
2026-03-27 20:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 017ccd51-324c-5687-b400-0dbd8114a051 with identifier: UK22118 to the API
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-28T16:54:09Z',
 'fuel_type': 'hybrid',
 'id': '017ccd51-324c-5687-b400-0dbd8114a051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK22118',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 201261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-03',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK22118%27 HTTP/1.1" 200 None
2026-03-27 20:32:52 [auto1.be] INFO: Saving data for UK22118: {'auction_closing_time': 1774716849.0, 'created_time': 1773134447.739883, 'last_price_update_time': 1774643572.981879}
2026-03-27 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UK22118') HTTP/1.1" 204 0
2026-03-27 20:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2147fb82-f258-5bf6-8225-7c6a49c43460 with identifier: RJ05295
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-27 20:32:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2147fb82-f258-5bf6-8225-7c6a49c43460 with identifier: RJ05295
2026-03-27 20:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2147fb82-f258-5bf6-8225-7c6a49c43460 with identifier: RJ05295 to the API
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:14:43Z',
 'fuel_type': 'diesel',
 'id': '2147fb82-f258-5bf6-8225-7c6a49c43460',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ05295',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 232894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-19',
 'seller_name': None,
 'title': 'Jaguar XF 2.2 D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ05295%27 HTTP/1.1" 200 None
2026-03-27 20:32:53 [auto1.be] INFO: Saving data for RJ05295: {'auction_closing_time': 1774714483.0, 'created_time': 1774471295.374925, 'last_price_update_time': 1774643573.483776}
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ05295') HTTP/1.1" 204 0
2026-03-27 20:32:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:53 [auto1.be] INFO: Found listing with ID: GM27988
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM27988%27 HTTP/1.1" 200 None
2026-03-27 20:32:53 [auto1.be] INFO: Scrape type for GM27988: 1
2026-03-27 20:32:53 [auto1.be] INFO: Found listing with ID: SU53193
2026-03-27 20:32:53 [auto1.be] INFO: Found listing with ID: EG72902
2026-03-27 20:32:53 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-27 20:32:53 [auto1.be] INFO: Scrape type for WJ68976: 1
2026-03-27 20:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT11769/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:53 [auto1.be] INFO: Found listing with ID: ED46000
2026-03-27 20:32:53 [auto1.be] INFO: Found listing with ID: MU65745
2026-03-27 20:32:53 [auto1.be] INFO: Found listing with ID: RK66755
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK66755%27 HTTP/1.1" 200 None
2026-03-27 20:32:53 [auto1.be] INFO: Scrape type for RK66755: 2
2026-03-27 20:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 122825f2-4986-556b-8b7c-aeecced82292 with identifier: RK66755
2026-03-27 20:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 122825f2-4986-556b-8b7c-aeecced82292 with scrape type 2
2026-03-27 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 122825f2-4986-556b-8b7c-aeecced82292 with scrape type 2
2026-03-27 20:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 122825f2-4986-556b-8b7c-aeecced82292, identifier: RK66755
2026-03-27 20:32:53 [auto1.be] INFO: Found listing with ID: YC45178
2026-03-27 20:32:53 [auto1.be] INFO: Found listing with ID: DM59351
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM59351%27 HTTP/1.1" 200 None
2026-03-27 20:32:53 [auto1.be] INFO: Scrape type for DM59351: 2
2026-03-27 20:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7b26b29-e35e-572e-9fc8-6b59507bdd68 with identifier: DM59351
2026-03-27 20:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7b26b29-e35e-572e-9fc8-6b59507bdd68 with scrape type 2
2026-03-27 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7b26b29-e35e-572e-9fc8-6b59507bdd68 with scrape type 2
2026-03-27 20:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f7b26b29-e35e-572e-9fc8-6b59507bdd68, identifier: DM59351
2026-03-27 20:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA16395/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 122825f2-4986-556b-8b7c-aeecced82292 with identifier: RK66755
2026-03-27 20:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 122825f2-4986-556b-8b7c-aeecced82292 with identifier: RK66755
2026-03-27 20:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 122825f2-4986-556b-8b7c-aeecced82292 with identifier: RK66755 to the API
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:51:32Z',
 'fuel_type': 'diesel',
 'id': '122825f2-4986-556b-8b7c-aeecced82292',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK66755',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 267895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-03',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2013}
2026-03-27 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK66755%27 HTTP/1.1" 200 None
2026-03-27 20:32:54 [auto1.be] INFO: Saving data for RK66755: {'auction_closing_time': 1774716692.0, 'created_time': 1774470970.190261, 'last_price_update_time': 1774643574.007806}
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK66755') HTTP/1.1" 204 0
2026-03-27 20:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f7b26b29-e35e-572e-9fc8-6b59507bdd68 with identifier: DM59351
2026-03-27 20:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f7b26b29-e35e-572e-9fc8-6b59507bdd68 with identifier: DM59351
2026-03-27 20:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f7b26b29-e35e-572e-9fc8-6b59507bdd68 with identifier: DM59351 to the API
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:55:57Z',
 'fuel_type': 'diesel',
 'id': 'f7b26b29-e35e-572e-9fc8-6b59507bdd68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM59351',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 277968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-06',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2014}
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM59351%27 HTTP/1.1" 200 None
2026-03-27 20:32:54 [auto1.be] INFO: Saving data for DM59351: {'auction_closing_time': 1774716957.0, 'created_time': 1774471356.829265, 'last_price_update_time': 1774643574.308068}
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DM59351') HTTP/1.1" 204 0
2026-03-27 20:32:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92e123c0-aa43-58b1-8bd3-d2d74999c5eb with identifier: KY96002
2026-03-27 20:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92e123c0-aa43-58b1-8bd3-d2d74999c5eb with scrape type 1
2026-03-27 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 92e123c0-aa43-58b1-8bd3-d2d74999c5eb
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F02%252F5902f02b737fb441551bcae4c0e1407b%252Fpa%252FKY96002_8da47a379f7c23e2009bd071e65d247c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_8da47a379f7c23e2009bd071e65d247c.jpg already downloaded
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F02%252F5902f02b737fb441551bcae4c0e1407b%252Fpa%252FKY96002_e0ad14ead68b7429f50a6df742f798c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_e0ad14ead68b7429f50a6df742f798c4.jpg already downloaded
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F02%252F5902f02b737fb441551bcae4c0e1407b%252Fpa%252FKY96002_27a7a7f43940593ceb9f083e848c3bf2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_27a7a7f43940593ceb9f083e848c3bf2.jpg already downloaded
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F02%252F5902f02b737fb441551bcae4c0e1407b%252Fpa%252FKY96002_846bc4237e50d4251d9f54ce6e46090b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_846bc4237e50d4251d9f54ce6e46090b.jpg already downloaded
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F02%252F5902f02b737fb441551bcae4c0e1407b%252Fpa%252FKY96002_08c9e388f70843c6e74f10a8e9956151.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_08c9e388f70843c6e74f10a8e9956151.jpg already downloaded
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F02%252F5902f02b737fb441551bcae4c0e1407b%252Fpa%252FKY96002_48c6eb43cbdbc1d9b8f11d7df669dd4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_48c6eb43cbdbc1d9b8f11d7df669dd4b.jpg already downloaded
2026-03-27 20:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 92e123c0-aa43-58b1-8bd3-d2d74999c5eb, identifier: KY96002
2026-03-27 20:32:54 [auto1.be] INFO: Found listing with ID: KU14362
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU14362%27 HTTP/1.1" 200 None
2026-03-27 20:32:54 [auto1.be] INFO: Scrape type for KU14362: 2
2026-03-27 20:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9657241b-7fff-50ae-a433-f5bbf040a07f with identifier: KU14362
2026-03-27 20:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9657241b-7fff-50ae-a433-f5bbf040a07f with scrape type 2
2026-03-27 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9657241b-7fff-50ae-a433-f5bbf040a07f with scrape type 2
2026-03-27 20:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9657241b-7fff-50ae-a433-f5bbf040a07f, identifier: KU14362
2026-03-27 20:32:54 [auto1.be] INFO: Found listing with ID: ZU26363
2026-03-27 20:32:54 [auto1.be] INFO: Found listing with ID: ZJ61910
2026-03-27 20:32:54 [auto1.be] INFO: Found listing with ID: FP51010
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP51010%27 HTTP/1.1" 200 None
2026-03-27 20:32:54 [auto1.be] INFO: Scrape type for FP51010: 2
2026-03-27 20:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c84b388-3fad-579e-9c36-431515e22f56 with identifier: FP51010
2026-03-27 20:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c84b388-3fad-579e-9c36-431515e22f56 with scrape type 2
2026-03-27 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c84b388-3fad-579e-9c36-431515e22f56 with scrape type 2
2026-03-27 20:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c84b388-3fad-579e-9c36-431515e22f56, identifier: FP51010
2026-03-27 20:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 92e123c0-aa43-58b1-8bd3-d2d74999c5eb with identifier: KY96002
2026-03-27 20:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 92e123c0-aa43-58b1-8bd3-d2d74999c5eb with identifier: KY96002
2026-03-27 20:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 92e123c0-aa43-58b1-8bd3-d2d74999c5eb with identifier: KY96002 to the API
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KY96002>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:11:17Z',
 'fuel_type': 'diesel',
 'id': '92e123c0-aa43-58b1-8bd3-d2d74999c5eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY96002',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 283200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_8da47a379f7c23e2009bd071e65d247c.jpg',
                'https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_e0ad14ead68b7429f50a6df742f798c4.jpg',
                'https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_27a7a7f43940593ceb9f083e848c3bf2.jpg',
                'https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_846bc4237e50d4251d9f54ce6e46090b.jpg',
                'https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_08c9e388f70843c6e74f10a8e9956151.jpg',
                'https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_48c6eb43cbdbc1d9b8f11d7df669dd4b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e123c0-aa43-58b1-8bd3-d2d74999c5eb/92e123c0-aa43-58b1-8bd3-d2d74999c5eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_8da47a379f7c23e2009bd071e65d247c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e123c0-aa43-58b1-8bd3-d2d74999c5eb/92e123c0-aa43-58b1-8bd3-d2d74999c5eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_e0ad14ead68b7429f50a6df742f798c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e123c0-aa43-58b1-8bd3-d2d74999c5eb/92e123c0-aa43-58b1-8bd3-d2d74999c5eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_27a7a7f43940593ceb9f083e848c3bf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e123c0-aa43-58b1-8bd3-d2d74999c5eb/92e123c0-aa43-58b1-8bd3-d2d74999c5eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_846bc4237e50d4251d9f54ce6e46090b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e123c0-aa43-58b1-8bd3-d2d74999c5eb/92e123c0-aa43-58b1-8bd3-d2d74999c5eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_08c9e388f70843c6e74f10a8e9956151.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e123c0-aa43-58b1-8bd3-d2d74999c5eb/92e123c0-aa43-58b1-8bd3-d2d74999c5eb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/02/5902f02b737fb441551bcae4c0e1407b/pa/KY96002_48c6eb43cbdbc1d9b8f11d7df669dd4b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KY96002%27 HTTP/1.1" 200 None
2026-03-27 20:32:55 [auto1.be] INFO: Saving data for KY96002: {'created_time': 1774643575.019047, 'last_price_update_time': 1774643575.019057, 'auction_closing_time': 1774714277.0}
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KY96002') HTTP/1.1" 204 0
2026-03-27 20:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9657241b-7fff-50ae-a433-f5bbf040a07f with identifier: KU14362
2026-03-27 20:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9657241b-7fff-50ae-a433-f5bbf040a07f with identifier: KU14362
2026-03-27 20:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9657241b-7fff-50ae-a433-f5bbf040a07f with identifier: KU14362 to the API
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:11:36Z',
 'fuel_type': 'diesel',
 'id': '9657241b-7fff-50ae-a433-f5bbf040a07f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU14362',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 192684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'BMW X6 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU14362%27 HTTP/1.1" 200 None
2026-03-27 20:32:55 [auto1.be] INFO: Saving data for KU14362: {'auction_closing_time': 1774714296.0, 'created_time': 1774471331.318643, 'last_price_update_time': 1774643575.380038}
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU14362') HTTP/1.1" 204 0
2026-03-27 20:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c84b388-3fad-579e-9c36-431515e22f56 with identifier: FP51010
2026-03-27 20:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c84b388-3fad-579e-9c36-431515e22f56 with identifier: FP51010
2026-03-27 20:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c84b388-3fad-579e-9c36-431515e22f56 with identifier: FP51010 to the API
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:15:12Z',
 'fuel_type': 'diesel',
 'id': '8c84b388-3fad-579e-9c36-431515e22f56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP51010',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 77383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-11',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP51010%27 HTTP/1.1" 200 None
2026-03-27 20:32:55 [auto1.be] INFO: Saving data for FP51010: {'auction_closing_time': 1774714512.0, 'created_time': 1774471376.216532, 'last_price_update_time': 1774643575.65353}
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FP51010') HTTP/1.1" 204 0
2026-03-27 20:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW25551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:55 [auto1.be] INFO: Found listing with ID: CK52379
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK52379%27 HTTP/1.1" 200 None
2026-03-27 20:32:55 [auto1.be] INFO: Scrape type for CK52379: 2
2026-03-27 20:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ea7124-8a2d-5f05-9325-67e65ba7d5a7 with identifier: CK52379
2026-03-27 20:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ea7124-8a2d-5f05-9325-67e65ba7d5a7 with scrape type 2
2026-03-27 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30ea7124-8a2d-5f05-9325-67e65ba7d5a7 with scrape type 2
2026-03-27 20:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30ea7124-8a2d-5f05-9325-67e65ba7d5a7, identifier: CK52379
2026-03-27 20:32:55 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-27 20:32:55 [auto1.be] INFO: Scrape type for CH15764: 2
2026-03-27 20:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764
2026-03-27 20:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with scrape type 2
2026-03-27 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with scrape type 2
2026-03-27 20:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3, identifier: CH15764
2026-03-27 20:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD79780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30ea7124-8a2d-5f05-9325-67e65ba7d5a7 with identifier: CK52379
2026-03-27 20:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30ea7124-8a2d-5f05-9325-67e65ba7d5a7 with identifier: CK52379
2026-03-27 20:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30ea7124-8a2d-5f05-9325-67e65ba7d5a7 with identifier: CK52379 to the API
2026-03-27 20:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:43:21Z',
 'fuel_type': 'petrol',
 'id': '30ea7124-8a2d-5f05-9325-67e65ba7d5a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK52379',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'RCZ',
 'odometer': 110638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-01',
 'seller_name': None,
 'title': 'Peugeot RCZ 1.6 THP Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2011}
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK52379%27 HTTP/1.1" 200 None
2026-03-27 20:32:56 [auto1.be] INFO: Saving data for CK52379: {'auction_closing_time': 1774716201.0, 'created_time': 1773238151.115291, 'last_price_update_time': 1774643576.127548}
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK52379') HTTP/1.1" 204 0
2026-03-27 20:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764
2026-03-27 20:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764
2026-03-27 20:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764 to the API
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:29:16Z',
 'fuel_type': 'petrol',
 'id': '2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH15764',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 115167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-16',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-27 20:32:56 [auto1.be] INFO: Saving data for CH15764: {'auction_closing_time': 1774715356.0, 'created_time': 1773693293.869452, 'last_price_update_time': 1774643576.424525}
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH15764') HTTP/1.1" 204 0
2026-03-27 20:32:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:56 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1659 | hits on page: 40
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: PH02429
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-27 20:32:56 [auto1.be] INFO: Scrape type for PK93774: 2
2026-03-27 20:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774
2026-03-27 20:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with scrape type 2
2026-03-27 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with scrape type 2
2026-03-27 20:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6, identifier: PK93774
2026-03-27 20:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774
2026-03-27 20:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774
2026-03-27 20:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774 to the API
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:13:17Z',
 'fuel_type': 'petrol',
 'id': '80540d39-9f1a-5ede-88b3-8ddfc1b51dc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK93774',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 17843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-09',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2023}
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-27 20:32:56 [auto1.be] INFO: Saving data for PK93774: {'auction_closing_time': 1774714397.0, 'created_time': 1773833840.727757, 'last_price_update_time': 1774643576.836907}
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PK93774') HTTP/1.1" 204 0
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-27 20:32:56 [auto1.be] INFO: Scrape type for PT26763: 1
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: RK22486
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: YS95861
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS95861%27 HTTP/1.1" 200 None
2026-03-27 20:32:56 [auto1.be] INFO: Scrape type for YS95861: 1
2026-03-27 20:32:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-27 20:32:56 [auto1.be] INFO: Scrape type for KW15988: 1
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: SP17871
2026-03-27 20:32:56 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-27 20:32:56 [auto1.be] INFO: Scrape type for AM54260: 2
2026-03-27 20:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260
2026-03-27 20:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with scrape type 2
2026-03-27 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with scrape type 2
2026-03-27 20:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d77d4183-7921-57e4-9dc2-3fb3d4766ee8, identifier: AM54260
2026-03-27 20:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC06950/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260
2026-03-27 20:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260
2026-03-27 20:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260 to the API
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:42:03Z',
 'fuel_type': 'diesel',
 'id': 'd77d4183-7921-57e4-9dc2-3fb3d4766ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM54260',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 203078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-17',
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 HDi Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2011}
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-27 20:32:57 [auto1.be] INFO: Saving data for AM54260: {'auction_closing_time': 1774716123.0, 'created_time': 1773909030.335938, 'last_price_update_time': 1774643577.336533}
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM54260') HTTP/1.1" 204 0
2026-03-27 20:32:57 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ87524%27 HTTP/1.1" 200 None
2026-03-27 20:32:57 [auto1.be] INFO: Scrape type for MJ87524: 2
2026-03-27 20:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e9b29e0-d457-5636-8efc-c646a68e0d22 with identifier: MJ87524
2026-03-27 20:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e9b29e0-d457-5636-8efc-c646a68e0d22 with scrape type 2
2026-03-27 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e9b29e0-d457-5636-8efc-c646a68e0d22 with scrape type 2
2026-03-27 20:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e9b29e0-d457-5636-8efc-c646a68e0d22, identifier: MJ87524
2026-03-27 20:32:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:57 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-27 20:32:57 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-27 20:32:57 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-27 20:32:57 [auto1.be] INFO: Scrape type for EA25293: 1
2026-03-27 20:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e9b29e0-d457-5636-8efc-c646a68e0d22 with identifier: MJ87524
2026-03-27 20:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e9b29e0-d457-5636-8efc-c646a68e0d22 with identifier: MJ87524
2026-03-27 20:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e9b29e0-d457-5636-8efc-c646a68e0d22 with identifier: MJ87524 to the API
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-28T16:34:48Z',
 'fuel_type': 'petrol',
 'id': '0e9b29e0-d457-5636-8efc-c646a68e0d22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ87524',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 203875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ87524%27 HTTP/1.1" 200 None
2026-03-27 20:32:57 [auto1.be] INFO: Saving data for MJ87524: {'auction_closing_time': 1774715688.0, 'created_time': 1774471371.994283, 'last_price_update_time': 1774643577.834826}
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ87524') HTTP/1.1" 204 0
2026-03-27 20:32:57 [auto1.be] INFO: Found listing with ID: EY95319
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY95319%27 HTTP/1.1" 200 None
2026-03-27 20:32:57 [auto1.be] INFO: Scrape type for EY95319: 2
2026-03-27 20:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c18568b7-c184-5441-a0b9-9ca1667ed06d with identifier: EY95319
2026-03-27 20:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c18568b7-c184-5441-a0b9-9ca1667ed06d with scrape type 2
2026-03-27 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c18568b7-c184-5441-a0b9-9ca1667ed06d with scrape type 2
2026-03-27 20:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c18568b7-c184-5441-a0b9-9ca1667ed06d, identifier: EY95319
2026-03-27 20:32:57 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-27 20:32:57 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-27 20:32:57 [auto1.be] INFO: Scrape type for YB94076: 1
2026-03-27 20:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c18568b7-c184-5441-a0b9-9ca1667ed06d with identifier: EY95319
2026-03-27 20:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c18568b7-c184-5441-a0b9-9ca1667ed06d with identifier: EY95319
2026-03-27 20:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c18568b7-c184-5441-a0b9-9ca1667ed06d with identifier: EY95319 to the API
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 144,
 'expiration_date': '2026-03-28T16:47:44Z',
 'fuel_type': 'diesel',
 'id': 'c18568b7-c184-5441-a0b9-9ca1667ed06d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY95319',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 11002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-29',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi',
 'transmission': 'manual',
 'trim': '',
 'year': 2024}
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY95319%27 HTTP/1.1" 200 None
2026-03-27 20:32:58 [auto1.be] INFO: Saving data for EY95319: {'auction_closing_time': 1774716464.0, 'created_time': 1773237349.135774, 'last_price_update_time': 1774643578.287353}
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EY95319') HTTP/1.1" 204 0
2026-03-27 20:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM27988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY54111/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:58 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-27 20:32:58 [auto1.be] INFO: Scrape type for YB47559: 2
2026-03-27 20:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559
2026-03-27 20:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c434bced-6124-571a-ab44-4176838b7555 with scrape type 2
2026-03-27 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c434bced-6124-571a-ab44-4176838b7555 with scrape type 2
2026-03-27 20:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c434bced-6124-571a-ab44-4176838b7555, identifier: YB47559
2026-03-27 20:32:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ68976/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559
2026-03-27 20:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559
2026-03-27 20:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559 to the API
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:44:04Z',
 'fuel_type': 'diesel',
 'id': 'c434bced-6124-571a-ab44-4176838b7555',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB47559',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 184273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-11',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2015}
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-27 20:32:58 [auto1.be] INFO: Saving data for YB47559: {'auction_closing_time': 1774716244.0, 'created_time': 1773434299.099478, 'last_price_update_time': 1774643578.699405}
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YB47559') HTTP/1.1" 204 0
2026-03-27 20:32:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:58 [auto1.be] INFO: Found listing with ID: HS77940
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS77940%27 HTTP/1.1" 200 None
2026-03-27 20:32:58 [auto1.be] INFO: Scrape type for HS77940: 2
2026-03-27 20:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f22f6d0f-66a2-541f-b8c0-4143f2fbd654 with identifier: HS77940
2026-03-27 20:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f22f6d0f-66a2-541f-b8c0-4143f2fbd654 with scrape type 2
2026-03-27 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f22f6d0f-66a2-541f-b8c0-4143f2fbd654 with scrape type 2
2026-03-27 20:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f22f6d0f-66a2-541f-b8c0-4143f2fbd654, identifier: HS77940
2026-03-27 20:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW19159/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f22f6d0f-66a2-541f-b8c0-4143f2fbd654 with identifier: HS77940
2026-03-27 20:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f22f6d0f-66a2-541f-b8c0-4143f2fbd654 with identifier: HS77940
2026-03-27 20:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f22f6d0f-66a2-541f-b8c0-4143f2fbd654 with identifier: HS77940 to the API
2026-03-27 20:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:45Z',
 'fuel_type': 'petrol',
 'id': 'f22f6d0f-66a2-541f-b8c0-4143f2fbd654',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS77940',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 9052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2024}
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS77940%27 HTTP/1.1" 200 None
2026-03-27 20:32:59 [auto1.be] INFO: Saving data for HS77940: {'auction_closing_time': 1774716765.0, 'created_time': 1774506733.716493, 'last_price_update_time': 1774643579.103883}
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS77940') HTTP/1.1" 204 0
2026-03-27 20:32:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:59 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-27 20:32:59 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-27 20:32:59 [auto1.be] INFO: Scrape type for CX99155: 1
2026-03-27 20:32:59 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-27 20:32:59 [auto1.be] INFO: Scrape type for JC96921: 1
2026-03-27 20:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT11769> (referer: https://www.auto1.com/v1/car-details-view/AT11769/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:32:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:32:59 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-27 20:32:59 [auto1.be] INFO: Scrape type for LP39108: 1
2026-03-27 20:32:59 [auto1.be] INFO: Found listing with ID: PK56681
2026-03-27 20:32:59 [auto1.be] INFO: Found listing with ID: NB55851
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB55851%27 HTTP/1.1" 200 None
2026-03-27 20:32:59 [auto1.be] INFO: Scrape type for NB55851: 1
2026-03-27 20:32:59 [auto1.be] INFO: Found listing with ID: YV05904
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV05904%27 HTTP/1.1" 200 None
2026-03-27 20:32:59 [auto1.be] INFO: Scrape type for YV05904: 1
2026-03-27 20:32:59 [auto1.be] INFO: Found listing with ID: ED29224
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED29224%27 HTTP/1.1" 200 None
2026-03-27 20:32:59 [auto1.be] INFO: Scrape type for ED29224: 2
2026-03-27 20:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2369001d-4635-5640-a4c6-ff56e3c41b96 with identifier: ED29224
2026-03-27 20:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2369001d-4635-5640-a4c6-ff56e3c41b96 with scrape type 2
2026-03-27 20:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2369001d-4635-5640-a4c6-ff56e3c41b96 with scrape type 2
2026-03-27 20:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2369001d-4635-5640-a4c6-ff56e3c41b96, identifier: ED29224
2026-03-27 20:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2369001d-4635-5640-a4c6-ff56e3c41b96 with identifier: ED29224
2026-03-27 20:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2369001d-4635-5640-a4c6-ff56e3c41b96 with identifier: ED29224
2026-03-27 20:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2369001d-4635-5640-a4c6-ff56e3c41b96 with identifier: ED29224 to the API
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:42:16Z',
 'fuel_type': 'diesel',
 'id': '2369001d-4635-5640-a4c6-ff56e3c41b96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED29224',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 129298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-21',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED29224%27 HTTP/1.1" 200 None
2026-03-27 20:32:59 [auto1.be] INFO: Saving data for ED29224: {'auction_closing_time': 1774716136.0, 'created_time': 1773238480.14745, 'last_price_update_time': 1774643579.61276}
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED29224') HTTP/1.1" 204 0
2026-03-27 20:32:59 [auto1.be] INFO: Found listing with ID: TT40798
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT40798%27 HTTP/1.1" 200 None
2026-03-27 20:32:59 [auto1.be] INFO: Scrape type for TT40798: 2
2026-03-27 20:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9421014b-238e-5469-82ae-45b5781550f4 with identifier: TT40798
2026-03-27 20:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9421014b-238e-5469-82ae-45b5781550f4 with scrape type 2
2026-03-27 20:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9421014b-238e-5469-82ae-45b5781550f4 with scrape type 2
2026-03-27 20:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9421014b-238e-5469-82ae-45b5781550f4, identifier: TT40798
2026-03-27 20:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9421014b-238e-5469-82ae-45b5781550f4 with identifier: TT40798
2026-03-27 20:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9421014b-238e-5469-82ae-45b5781550f4 with identifier: TT40798
2026-03-27 20:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9421014b-238e-5469-82ae-45b5781550f4 with identifier: TT40798 to the API
2026-03-27 20:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:19:54Z',
 'fuel_type': 'petrol',
 'id': '9421014b-238e-5469-82ae-45b5781550f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT40798',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo',
 'odometer': 126016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-08',
 'seller_name': None,
 'title': 'Ford Tourneo 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT40798%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [auto1.be] INFO: Saving data for TT40798: {'auction_closing_time': 1774714794.0, 'created_time': 1773137029.338054, 'last_price_update_time': 1774643580.13676}
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TT40798') HTTP/1.1" 204 0
2026-03-27 20:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e72cdfb1-de0c-528f-a454-257ce33a5954 with identifier: AT11769
2026-03-27 20:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e72cdfb1-de0c-528f-a454-257ce33a5954 with scrape type 1
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e72cdfb1-de0c-528f-a454-257ce33a5954
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff2%252Fb1f2b44e3fdfd9757e98c778b2decbf6%252Fpa%252FAT11769_351c0ad3c838dc30c96ec7605c746386.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_351c0ad3c838dc30c96ec7605c746386.jpg already downloaded
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff2%252Fb1f2b44e3fdfd9757e98c778b2decbf6%252Fpa%252FAT11769_354e1562365d7647d3aac222a9016ee1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_354e1562365d7647d3aac222a9016ee1.jpg already downloaded
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff2%252Fb1f2b44e3fdfd9757e98c778b2decbf6%252Fpa%252FAT11769_377adb89cf528f87b251a5de735c09f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_377adb89cf528f87b251a5de735c09f6.jpg already downloaded
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff2%252Fb1f2b44e3fdfd9757e98c778b2decbf6%252Fpa%252FAT11769_4eca3d37a706ebdaa8f9cbef081ebbef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_4eca3d37a706ebdaa8f9cbef081ebbef.jpg already downloaded
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff2%252Fb1f2b44e3fdfd9757e98c778b2decbf6%252Fpa%252FAT11769_9cc2bac11a8f6fbfd99b51115a44fa84.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_9cc2bac11a8f6fbfd99b51115a44fa84.jpg already downloaded
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff2%252Fb1f2b44e3fdfd9757e98c778b2decbf6%252Fpa%252FAT11769_4cd1a70a50cb6f9fcba9858e3478460c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_4cd1a70a50cb6f9fcba9858e3478460c.jpg already downloaded
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff2%252Fb1f2b44e3fdfd9757e98c778b2decbf6%252Fpa%252FAT11769_553e1189c949a8833e0277c112c850a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_553e1189c949a8833e0277c112c850a4.jpg already downloaded
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff2%252Fb1f2b44e3fdfd9757e98c778b2decbf6%252Fpa%252FAT11769_0e090ab0981717d42b547d2276191fec.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_0e090ab0981717d42b547d2276191fec.jpg already downloaded
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff2%252Fb1f2b44e3fdfd9757e98c778b2decbf6%252Fpa%252FAT11769_14d9bfc179fa360c670708cde7c763a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_14d9bfc179fa360c670708cde7c763a7.jpg already downloaded
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff2%252Fb1f2b44e3fdfd9757e98c778b2decbf6%252Fpa%252FAT11769_a109c6c2ef0a4c8fe2c36afca74680f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_a109c6c2ef0a4c8fe2c36afca74680f1.jpg already downloaded
2026-03-27 20:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e72cdfb1-de0c-528f-a454-257ce33a5954, identifier: AT11769
2026-03-27 20:33:00 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-27 20:33:00 [auto1.be] INFO: Found listing with ID: BY03378
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY03378%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [auto1.be] INFO: Scrape type for BY03378: 1
2026-03-27 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA16395> (referer: https://www.auto1.com/v1/car-details-view/TA16395/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e72cdfb1-de0c-528f-a454-257ce33a5954 with identifier: AT11769
2026-03-27 20:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e72cdfb1-de0c-528f-a454-257ce33a5954 with identifier: AT11769
2026-03-27 20:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e72cdfb1-de0c-528f-a454-257ce33a5954 with identifier: AT11769 to the API
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AT11769>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:15:50Z',
 'fuel_type': 'hybrid',
 'id': 'e72cdfb1-de0c-528f-a454-257ce33a5954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT11769',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 105213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_351c0ad3c838dc30c96ec7605c746386.jpg',
                'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_354e1562365d7647d3aac222a9016ee1.jpg',
                'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_377adb89cf528f87b251a5de735c09f6.jpg',
                'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_4eca3d37a706ebdaa8f9cbef081ebbef.jpg',
                'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_9cc2bac11a8f6fbfd99b51115a44fa84.jpg',
                'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_4cd1a70a50cb6f9fcba9858e3478460c.jpg',
                'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_553e1189c949a8833e0277c112c850a4.jpg',
                'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_0e090ab0981717d42b547d2276191fec.jpg',
                'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_14d9bfc179fa360c670708cde7c763a7.jpg',
                'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_a109c6c2ef0a4c8fe2c36afca74680f1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72cdfb1-de0c-528f-a454-257ce33a5954/e72cdfb1-de0c-528f-a454-257ce33a5954_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_351c0ad3c838dc30c96ec7605c746386.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72cdfb1-de0c-528f-a454-257ce33a5954/e72cdfb1-de0c-528f-a454-257ce33a5954_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_354e1562365d7647d3aac222a9016ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72cdfb1-de0c-528f-a454-257ce33a5954/e72cdfb1-de0c-528f-a454-257ce33a5954_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_377adb89cf528f87b251a5de735c09f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72cdfb1-de0c-528f-a454-257ce33a5954/e72cdfb1-de0c-528f-a454-257ce33a5954_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_4eca3d37a706ebdaa8f9cbef081ebbef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72cdfb1-de0c-528f-a454-257ce33a5954/e72cdfb1-de0c-528f-a454-257ce33a5954_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_9cc2bac11a8f6fbfd99b51115a44fa84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72cdfb1-de0c-528f-a454-257ce33a5954/e72cdfb1-de0c-528f-a454-257ce33a5954_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_4cd1a70a50cb6f9fcba9858e3478460c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72cdfb1-de0c-528f-a454-257ce33a5954/e72cdfb1-de0c-528f-a454-257ce33a5954_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_553e1189c949a8833e0277c112c850a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72cdfb1-de0c-528f-a454-257ce33a5954/e72cdfb1-de0c-528f-a454-257ce33a5954_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_0e090ab0981717d42b547d2276191fec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72cdfb1-de0c-528f-a454-257ce33a5954/e72cdfb1-de0c-528f-a454-257ce33a5954_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_14d9bfc179fa360c670708cde7c763a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72cdfb1-de0c-528f-a454-257ce33a5954/e72cdfb1-de0c-528f-a454-257ce33a5954_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f2/b1f2b44e3fdfd9757e98c778b2decbf6/pa/AT11769_a109c6c2ef0a4c8fe2c36afca74680f1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 300 Hybrid BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2015}
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT11769%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [auto1.be] INFO: Saving data for AT11769: {'created_time': 1774643580.703724, 'last_price_update_time': 1774643580.703734, 'auction_closing_time': 1774714550.0}
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AT11769') HTTP/1.1" 204 0
2026-03-27 20:33:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:00 [auto1.be] INFO: Found listing with ID: DL69403
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL69403%27 HTTP/1.1" 200 None
2026-03-27 20:33:00 [auto1.be] INFO: Scrape type for DL69403: 2
2026-03-27 20:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8db9eb51-cb6f-54c8-a6ea-5216816454a8 with identifier: DL69403
2026-03-27 20:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8db9eb51-cb6f-54c8-a6ea-5216816454a8 with scrape type 2
2026-03-27 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8db9eb51-cb6f-54c8-a6ea-5216816454a8 with scrape type 2
2026-03-27 20:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8db9eb51-cb6f-54c8-a6ea-5216816454a8, identifier: DL69403
2026-03-27 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT26763/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8db9eb51-cb6f-54c8-a6ea-5216816454a8 with identifier: DL69403
2026-03-27 20:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8db9eb51-cb6f-54c8-a6ea-5216816454a8 with identifier: DL69403
2026-03-27 20:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8db9eb51-cb6f-54c8-a6ea-5216816454a8 with identifier: DL69403 to the API
2026-03-27 20:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:35:04Z',
 'fuel_type': 'petrol',
 'id': '8db9eb51-cb6f-54c8-a6ea-5216816454a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL69403',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 88311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-10',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL69403%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [auto1.be] INFO: Saving data for DL69403: {'auction_closing_time': 1774715704.0, 'created_time': 1773136293.076227, 'last_price_update_time': 1774643581.148259}
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DL69403') HTTP/1.1" 204 0
2026-03-27 20:33:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b6575e1-3ff1-5c72-9624-805b373fb47c with identifier: TA16395
2026-03-27 20:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b6575e1-3ff1-5c72-9624-805b373fb47c with scrape type 1
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b6575e1-3ff1-5c72-9624-805b373fb47c
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F24%252F0b24d73b90cc5356af4d27807dd4e743%252Fpa%252FTA16395_51cba6262b1086a41e26b0604273400e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_51cba6262b1086a41e26b0604273400e.jpg already downloaded
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F24%252F0b24d73b90cc5356af4d27807dd4e743%252Fpa%252FTA16395_7ceec09042efec215addc88d8a5ec061.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_7ceec09042efec215addc88d8a5ec061.jpg already downloaded
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F24%252F0b24d73b90cc5356af4d27807dd4e743%252Fpa%252FTA16395_7e15ae5199e1985f95c823c2298e909f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_7e15ae5199e1985f95c823c2298e909f.jpg already downloaded
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F24%252F0b24d73b90cc5356af4d27807dd4e743%252Fpa%252FTA16395_4ff79ade245df5696ffc2ff2a30834b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_4ff79ade245df5696ffc2ff2a30834b1.jpg already downloaded
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F24%252F0b24d73b90cc5356af4d27807dd4e743%252Fpa%252FTA16395_b26b1a0f41e0e723f15e1d4e8f65b200.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_b26b1a0f41e0e723f15e1d4e8f65b200.jpg already downloaded
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F24%252F0b24d73b90cc5356af4d27807dd4e743%252Fpa%252FTA16395_bdd590f85f43f0bfecc5c7e2e39d1e05.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_bdd590f85f43f0bfecc5c7e2e39d1e05.jpg already downloaded
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F24%252F0b24d73b90cc5356af4d27807dd4e743%252Fpa%252FTA16395_013c40e65eedf18e1adcf7d58070d5e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_013c40e65eedf18e1adcf7d58070d5e2.jpg already downloaded
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F24%252F0b24d73b90cc5356af4d27807dd4e743%252Fpa%252FTA16395_903c59b83d87872cc0a054aa6e6ac203.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_903c59b83d87872cc0a054aa6e6ac203.jpg already downloaded
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F24%252F0b24d73b90cc5356af4d27807dd4e743%252Fpa%252FTA16395_5f7111df09672b921c4089a865e12783.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_5f7111df09672b921c4089a865e12783.jpg already downloaded
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F24%252F0b24d73b90cc5356af4d27807dd4e743%252Fpa%252FTA16395_07442b19e5b49c04d0e33ae0b8d3a21c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_07442b19e5b49c04d0e33ae0b8d3a21c.jpg already downloaded
2026-03-27 20:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7b6575e1-3ff1-5c72-9624-805b373fb47c, identifier: TA16395
2026-03-27 20:33:01 [auto1.be] INFO: Found listing with ID: BW39031
2026-03-27 20:33:01 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-27 20:33:01 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-27 20:33:01 [auto1.be] INFO: Found listing with ID: ZC14202
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC14202%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [auto1.be] INFO: Scrape type for ZC14202: 1
2026-03-27 20:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7b6575e1-3ff1-5c72-9624-805b373fb47c with identifier: TA16395
2026-03-27 20:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7b6575e1-3ff1-5c72-9624-805b373fb47c with identifier: TA16395
2026-03-27 20:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7b6575e1-3ff1-5c72-9624-805b373fb47c with identifier: TA16395 to the API
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TA16395>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:41Z',
 'fuel_type': 'diesel',
 'id': '7b6575e1-3ff1-5c72-9624-805b373fb47c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA16395',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 127248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_51cba6262b1086a41e26b0604273400e.jpg',
                'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_7ceec09042efec215addc88d8a5ec061.jpg',
                'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_7e15ae5199e1985f95c823c2298e909f.jpg',
                'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_4ff79ade245df5696ffc2ff2a30834b1.jpg',
                'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_b26b1a0f41e0e723f15e1d4e8f65b200.jpg',
                'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_bdd590f85f43f0bfecc5c7e2e39d1e05.jpg',
                'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_013c40e65eedf18e1adcf7d58070d5e2.jpg',
                'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_903c59b83d87872cc0a054aa6e6ac203.jpg',
                'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_5f7111df09672b921c4089a865e12783.jpg',
                'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_07442b19e5b49c04d0e33ae0b8d3a21c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6575e1-3ff1-5c72-9624-805b373fb47c/7b6575e1-3ff1-5c72-9624-805b373fb47c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_51cba6262b1086a41e26b0604273400e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6575e1-3ff1-5c72-9624-805b373fb47c/7b6575e1-3ff1-5c72-9624-805b373fb47c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_7ceec09042efec215addc88d8a5ec061.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6575e1-3ff1-5c72-9624-805b373fb47c/7b6575e1-3ff1-5c72-9624-805b373fb47c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_7e15ae5199e1985f95c823c2298e909f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6575e1-3ff1-5c72-9624-805b373fb47c/7b6575e1-3ff1-5c72-9624-805b373fb47c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_4ff79ade245df5696ffc2ff2a30834b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6575e1-3ff1-5c72-9624-805b373fb47c/7b6575e1-3ff1-5c72-9624-805b373fb47c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_b26b1a0f41e0e723f15e1d4e8f65b200.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6575e1-3ff1-5c72-9624-805b373fb47c/7b6575e1-3ff1-5c72-9624-805b373fb47c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_bdd590f85f43f0bfecc5c7e2e39d1e05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6575e1-3ff1-5c72-9624-805b373fb47c/7b6575e1-3ff1-5c72-9624-805b373fb47c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_013c40e65eedf18e1adcf7d58070d5e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6575e1-3ff1-5c72-9624-805b373fb47c/7b6575e1-3ff1-5c72-9624-805b373fb47c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_903c59b83d87872cc0a054aa6e6ac203.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6575e1-3ff1-5c72-9624-805b373fb47c/7b6575e1-3ff1-5c72-9624-805b373fb47c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_5f7111df09672b921c4089a865e12783.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6575e1-3ff1-5c72-9624-805b373fb47c/7b6575e1-3ff1-5c72-9624-805b373fb47c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/24/0b24d73b90cc5356af4d27807dd4e743/pa/TA16395_07442b19e5b49c04d0e33ae0b8d3a21c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2017}
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA16395%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [auto1.be] INFO: Saving data for TA16395: {'created_time': 1774643581.721914, 'last_price_update_time': 1774643581.721923, 'auction_closing_time': 1774716761.0}
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TA16395') HTTP/1.1" 204 0
2026-03-27 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:01 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-27 20:33:01 [auto1.be] INFO: Found listing with ID: AB96361
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB96361%27 HTTP/1.1" 200 None
2026-03-27 20:33:01 [auto1.be] INFO: Scrape type for AB96361: 2
2026-03-27 20:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3714a05a-3ef0-5b6f-a972-d0faa1d1c0ba with identifier: AB96361
2026-03-27 20:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3714a05a-3ef0-5b6f-a972-d0faa1d1c0ba with scrape type 2
2026-03-27 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3714a05a-3ef0-5b6f-a972-d0faa1d1c0ba with scrape type 2
2026-03-27 20:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3714a05a-3ef0-5b6f-a972-d0faa1d1c0ba, identifier: AB96361
2026-03-27 20:33:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW15988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW25551> (referer: https://www.auto1.com/v1/car-details-view/WW25551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD79780> (referer: https://www.auto1.com/v1/car-details-view/BD79780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3714a05a-3ef0-5b6f-a972-d0faa1d1c0ba with identifier: AB96361
2026-03-27 20:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3714a05a-3ef0-5b6f-a972-d0faa1d1c0ba with identifier: AB96361
2026-03-27 20:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3714a05a-3ef0-5b6f-a972-d0faa1d1c0ba with identifier: AB96361 to the API
2026-03-27 20:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:48:00Z',
 'fuel_type': 'diesel',
 'id': '3714a05a-3ef0-5b6f-a972-d0faa1d1c0ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB96361',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 209763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-26',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2015}
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB96361%27 HTTP/1.1" 200 None
2026-03-27 20:33:02 [auto1.be] INFO: Saving data for AB96361: {'auction_closing_time': 1774716480.0, 'created_time': 1773238407.154868, 'last_price_update_time': 1774643582.121364}
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB96361') HTTP/1.1" 204 0
2026-03-27 20:33:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS95861/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:02 [auto1.be] INFO: Found listing with ID: BF15536
2026-03-27 20:33:02 [auto1.be] INFO: Found listing with ID: PC04988
2026-03-27 20:33:02 [auto1.be] INFO: Found listing with ID: YG09924
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG09924%27 HTTP/1.1" 200 None
2026-03-27 20:33:02 [auto1.be] INFO: Scrape type for YG09924: 2
2026-03-27 20:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4627663-5973-5772-9f94-8974ac70cdde with identifier: YG09924
2026-03-27 20:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4627663-5973-5772-9f94-8974ac70cdde with scrape type 2
2026-03-27 20:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4627663-5973-5772-9f94-8974ac70cdde with scrape type 2
2026-03-27 20:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a4627663-5973-5772-9f94-8974ac70cdde, identifier: YG09924
2026-03-27 20:33:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a4627663-5973-5772-9f94-8974ac70cdde with identifier: YG09924
2026-03-27 20:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a4627663-5973-5772-9f94-8974ac70cdde with identifier: YG09924
2026-03-27 20:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a4627663-5973-5772-9f94-8974ac70cdde with identifier: YG09924 to the API
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:54:04Z',
 'fuel_type': 'diesel',
 'id': 'a4627663-5973-5772-9f94-8974ac70cdde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG09924',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 212303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-25',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG09924%27 HTTP/1.1" 200 None
2026-03-27 20:33:02 [auto1.be] INFO: Saving data for YG09924: {'auction_closing_time': 1774716844.0, 'created_time': 1773349552.258671, 'last_price_update_time': 1774643582.563818}
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YG09924') HTTP/1.1" 204 0
2026-03-27 20:33:02 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-27 20:33:02 [auto1.be] INFO: Found listing with ID: TG48894
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG48894%27 HTTP/1.1" 200 None
2026-03-27 20:33:02 [auto1.be] INFO: Scrape type for TG48894: 2
2026-03-27 20:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1952a71c-8403-5e6e-b626-48ad9735d778 with identifier: TG48894
2026-03-27 20:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1952a71c-8403-5e6e-b626-48ad9735d778 with scrape type 2
2026-03-27 20:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1952a71c-8403-5e6e-b626-48ad9735d778 with scrape type 2
2026-03-27 20:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1952a71c-8403-5e6e-b626-48ad9735d778, identifier: TG48894
2026-03-27 20:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1952a71c-8403-5e6e-b626-48ad9735d778 with identifier: TG48894
2026-03-27 20:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1952a71c-8403-5e6e-b626-48ad9735d778 with identifier: TG48894
2026-03-27 20:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1952a71c-8403-5e6e-b626-48ad9735d778 with identifier: TG48894 to the API
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:41:53Z',
 'fuel_type': 'diesel',
 'id': '1952a71c-8403-5e6e-b626-48ad9735d778',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG48894',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 251250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-09',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG48894%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [auto1.be] INFO: Saving data for TG48894: {'auction_closing_time': 1774716113.0, 'created_time': 1773238789.435763, 'last_price_update_time': 1774643583.040204}
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TG48894') HTTP/1.1" 204 0
2026-03-27 20:33:03 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1659 | hits on page: 40
2026-03-27 20:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a67a2e3-1999-5e59-8375-d6e6c272134f with identifier: WW25551
2026-03-27 20:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a67a2e3-1999-5e59-8375-d6e6c272134f with scrape type 1
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a67a2e3-1999-5e59-8375-d6e6c272134f
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_325a1358e39f628299e595e5584278d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_325a1358e39f628299e595e5584278d1.jpg not downloaded yet
2026-03-27 20:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c572c63f-9ee2-583a-a563-02a40f919f01 with identifier: BD79780
2026-03-27 20:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c572c63f-9ee2-583a-a563-02a40f919f01 with scrape type 1
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c572c63f-9ee2-583a-a563-02a40f919f01
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F46465282a767dcd19e178bb0735aa474%252Fpa%252FBD79780_91d189b7f51542757c91f346491f3349.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_91d189b7f51542757c91f346491f3349.jpg already downloaded
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F46465282a767dcd19e178bb0735aa474%252Fpa%252FBD79780_43da536781956221c8df7c681648347e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_43da536781956221c8df7c681648347e.jpg already downloaded
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F46465282a767dcd19e178bb0735aa474%252Fpa%252FBD79780_5e5b3531900fea93c9e68729188253a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_5e5b3531900fea93c9e68729188253a5.jpg already downloaded
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F46465282a767dcd19e178bb0735aa474%252Fpa%252FBD79780_717517dfd63a250f84dc20696ae65e57.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_717517dfd63a250f84dc20696ae65e57.jpg already downloaded
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F46465282a767dcd19e178bb0735aa474%252Fpa%252FBD79780_64221140ccdc4c799959376489a66332.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_64221140ccdc4c799959376489a66332.jpg already downloaded
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F46465282a767dcd19e178bb0735aa474%252Fpa%252FBD79780_c89b15d2f5f40488effafffedac4e828.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_c89b15d2f5f40488effafffedac4e828.jpg already downloaded
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F46465282a767dcd19e178bb0735aa474%252Fpa%252FBD79780_0222702cbf4a2b87e547a76251ec0388.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_0222702cbf4a2b87e547a76251ec0388.jpg already downloaded
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F46465282a767dcd19e178bb0735aa474%252Fpa%252FBD79780_afb9a3e1437cc513e4188c0070f5d795.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_afb9a3e1437cc513e4188c0070f5d795.jpg already downloaded
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F46465282a767dcd19e178bb0735aa474%252Fpa%252FBD79780_52d0964eea3d9d0fefa69bb687b8e474.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_52d0964eea3d9d0fefa69bb687b8e474.jpg already downloaded
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F46465282a767dcd19e178bb0735aa474%252Fpa%252FBD79780_4a5eb75b22d1c85d136d45f7d5662aec.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_4a5eb75b22d1c85d136d45f7d5662aec.jpg already downloaded
2026-03-27 20:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c572c63f-9ee2-583a-a563-02a40f919f01, identifier: BD79780
2026-03-27 20:33:03 [auto1.be] INFO: Found listing with ID: MJ44397
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ44397%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [auto1.be] INFO: Scrape type for MJ44397: 2
2026-03-27 20:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcac549b-e15a-5ec2-898c-87c2ebc04ecf with identifier: MJ44397
2026-03-27 20:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcac549b-e15a-5ec2-898c-87c2ebc04ecf with scrape type 2
2026-03-27 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcac549b-e15a-5ec2-898c-87c2ebc04ecf with scrape type 2
2026-03-27 20:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fcac549b-e15a-5ec2-898c-87c2ebc04ecf, identifier: MJ44397
2026-03-27 20:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c572c63f-9ee2-583a-a563-02a40f919f01 with identifier: BD79780
2026-03-27 20:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c572c63f-9ee2-583a-a563-02a40f919f01 with identifier: BD79780
2026-03-27 20:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c572c63f-9ee2-583a-a563-02a40f919f01 with identifier: BD79780 to the API
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BD79780>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:38:43Z',
 'fuel_type': 'diesel',
 'id': 'c572c63f-9ee2-583a-a563-02a40f919f01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD79780',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 64570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_91d189b7f51542757c91f346491f3349.jpg',
                'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_43da536781956221c8df7c681648347e.jpg',
                'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_5e5b3531900fea93c9e68729188253a5.jpg',
                'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_717517dfd63a250f84dc20696ae65e57.jpg',
                'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_64221140ccdc4c799959376489a66332.jpg',
                'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_c89b15d2f5f40488effafffedac4e828.jpg',
                'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_0222702cbf4a2b87e547a76251ec0388.jpg',
                'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_afb9a3e1437cc513e4188c0070f5d795.jpg',
                'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_52d0964eea3d9d0fefa69bb687b8e474.jpg',
                'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_4a5eb75b22d1c85d136d45f7d5662aec.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c572c63f-9ee2-583a-a563-02a40f919f01/c572c63f-9ee2-583a-a563-02a40f919f01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_91d189b7f51542757c91f346491f3349.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c572c63f-9ee2-583a-a563-02a40f919f01/c572c63f-9ee2-583a-a563-02a40f919f01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_43da536781956221c8df7c681648347e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c572c63f-9ee2-583a-a563-02a40f919f01/c572c63f-9ee2-583a-a563-02a40f919f01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_5e5b3531900fea93c9e68729188253a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c572c63f-9ee2-583a-a563-02a40f919f01/c572c63f-9ee2-583a-a563-02a40f919f01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_717517dfd63a250f84dc20696ae65e57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c572c63f-9ee2-583a-a563-02a40f919f01/c572c63f-9ee2-583a-a563-02a40f919f01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_64221140ccdc4c799959376489a66332.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c572c63f-9ee2-583a-a563-02a40f919f01/c572c63f-9ee2-583a-a563-02a40f919f01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_c89b15d2f5f40488effafffedac4e828.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c572c63f-9ee2-583a-a563-02a40f919f01/c572c63f-9ee2-583a-a563-02a40f919f01_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_0222702cbf4a2b87e547a76251ec0388.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c572c63f-9ee2-583a-a563-02a40f919f01/c572c63f-9ee2-583a-a563-02a40f919f01_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_afb9a3e1437cc513e4188c0070f5d795.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c572c63f-9ee2-583a-a563-02a40f919f01/c572c63f-9ee2-583a-a563-02a40f919f01_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_52d0964eea3d9d0fefa69bb687b8e474.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c572c63f-9ee2-583a-a563-02a40f919f01/c572c63f-9ee2-583a-a563-02a40f919f01_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/46465282a767dcd19e178bb0735aa474/pa/BD79780_4a5eb75b22d1c85d136d45f7d5662aec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 Mild-Hybrid AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2020}
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD79780%27 HTTP/1.1" 200 None
2026-03-27 20:33:03 [auto1.be] INFO: Saving data for BD79780: {'created_time': 1774643583.738941, 'last_price_update_time': 1774643583.738952, 'auction_closing_time': 1774715923.0}
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD79780') HTTP/1.1" 204 0
2026-03-27 20:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fcac549b-e15a-5ec2-898c-87c2ebc04ecf with identifier: MJ44397
2026-03-27 20:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fcac549b-e15a-5ec2-898c-87c2ebc04ecf with identifier: MJ44397
2026-03-27 20:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fcac549b-e15a-5ec2-898c-87c2ebc04ecf with identifier: MJ44397 to the API
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:01:05Z',
 'fuel_type': 'petrol',
 'id': 'fcac549b-e15a-5ec2-898c-87c2ebc04ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ44397',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 127006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-01',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 e-THP XTR',
 'transmission': 'manual',
 'trim': 'XTR',
 'year': 2017}
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ44397%27 HTTP/1.1" 200 None
2026-03-27 20:33:04 [auto1.be] INFO: Saving data for MJ44397: {'auction_closing_time': 1774713665.0, 'created_time': 1773238792.572129, 'last_price_update_time': 1774643584.026808}
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ44397') HTTP/1.1" 204 0
2026-03-27 20:33:04 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-27 20:33:04 [auto1.be] INFO: Found listing with ID: UP37204
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UP37204%27 HTTP/1.1" 200 None
2026-03-27 20:33:04 [auto1.be] INFO: Scrape type for UP37204: 2
2026-03-27 20:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fc90898-cbce-53a7-8141-7aa9064f1122 with identifier: UP37204
2026-03-27 20:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fc90898-cbce-53a7-8141-7aa9064f1122 with scrape type 2
2026-03-27 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fc90898-cbce-53a7-8141-7aa9064f1122 with scrape type 2
2026-03-27 20:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6fc90898-cbce-53a7-8141-7aa9064f1122, identifier: UP37204
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_373819cc0edc488e9cdb5af9b9f50f63.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_373819cc0edc488e9cdb5af9b9f50f63.jpg not downloaded yet
2026-03-27 20:33:04 [auto1.be] INFO: Found listing with ID: HY14348
2026-03-27 20:33:04 [auto1.be] INFO: Found listing with ID: EA81543
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA81543%27 HTTP/1.1" 200 None
2026-03-27 20:33:04 [auto1.be] INFO: Scrape type for EA81543: 2
2026-03-27 20:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db6279af-4ad4-5450-a92f-7f88835ba06a with identifier: EA81543
2026-03-27 20:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db6279af-4ad4-5450-a92f-7f88835ba06a with scrape type 2
2026-03-27 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db6279af-4ad4-5450-a92f-7f88835ba06a with scrape type 2
2026-03-27 20:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db6279af-4ad4-5450-a92f-7f88835ba06a, identifier: EA81543
2026-03-27 20:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6fc90898-cbce-53a7-8141-7aa9064f1122 with identifier: UP37204
2026-03-27 20:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6fc90898-cbce-53a7-8141-7aa9064f1122 with identifier: UP37204
2026-03-27 20:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6fc90898-cbce-53a7-8141-7aa9064f1122 with identifier: UP37204 to the API
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:41:22Z',
 'fuel_type': 'diesel',
 'id': '6fc90898-cbce-53a7-8141-7aa9064f1122',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP37204',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 199299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-29',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Acenta +',
 'transmission': 'manual',
 'trim': 'Acenta +',
 'year': 2013}
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UP37204%27 HTTP/1.1" 200 None
2026-03-27 20:33:04 [auto1.be] INFO: Saving data for UP37204: {'auction_closing_time': 1774716082.0, 'created_time': 1773135932.412651, 'last_price_update_time': 1774643584.530853}
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UP37204') HTTP/1.1" 204 0
2026-03-27 20:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db6279af-4ad4-5450-a92f-7f88835ba06a with identifier: EA81543
2026-03-27 20:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db6279af-4ad4-5450-a92f-7f88835ba06a with identifier: EA81543
2026-03-27 20:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db6279af-4ad4-5450-a92f-7f88835ba06a with identifier: EA81543 to the API
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:42:38Z',
 'fuel_type': 'diesel',
 'id': 'db6279af-4ad4-5450-a92f-7f88835ba06a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA81543',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 262045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-20',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2011}
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA81543%27 HTTP/1.1" 200 None
2026-03-27 20:33:04 [auto1.be] INFO: Saving data for EA81543: {'auction_closing_time': 1774716158.0, 'created_time': 1773238604.46973, 'last_price_update_time': 1774643584.950643}
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EA81543') HTTP/1.1" 204 0
2026-03-27 20:33:04 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-27 20:33:04 [auto1.be] INFO: Scrape type for YF30387: 1
2026-03-27 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_881511f86e95e4fe496cdc17043ab479.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_881511f86e95e4fe496cdc17043ab479.jpg not downloaded yet
2026-03-27 20:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA25293/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC06950> (referer: https://www.auto1.com/v1/car-details-view/PC06950/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:05 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-27 20:33:05 [auto1.be] INFO: Scrape type for XT36171: 2
2026-03-27 20:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171
2026-03-27 20:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 179c51cc-9dad-54e5-903b-355803cbf100 with scrape type 2
2026-03-27 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 179c51cc-9dad-54e5-903b-355803cbf100 with scrape type 2
2026-03-27 20:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 179c51cc-9dad-54e5-903b-355803cbf100, identifier: XT36171
2026-03-27 20:33:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171
2026-03-27 20:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171
2026-03-27 20:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171 to the API
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:12:30Z',
 'fuel_type': 'gas',
 'id': '179c51cc-9dad-54e5-903b-355803cbf100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT36171',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 65029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-08',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-27 20:33:05 [auto1.be] INFO: Saving data for XT36171: {'auction_closing_time': 1774714350.0, 'created_time': 1773401498.481253, 'last_price_update_time': 1774643585.45423}
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT36171') HTTP/1.1" 204 0
2026-03-27 20:33:05 [auto1.be] INFO: Found listing with ID: TP34819
2026-03-27 20:33:05 [auto1.be] INFO: Found listing with ID: MV25434
2026-03-27 20:33:05 [auto1.be] INFO: Found listing with ID: EZ95206
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ95206%27 HTTP/1.1" 200 None
2026-03-27 20:33:05 [auto1.be] INFO: Scrape type for EZ95206: 2
2026-03-27 20:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d0a2637-8e8c-51f1-bf6f-1e2ee81066ea with identifier: EZ95206
2026-03-27 20:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d0a2637-8e8c-51f1-bf6f-1e2ee81066ea with scrape type 2
2026-03-27 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d0a2637-8e8c-51f1-bf6f-1e2ee81066ea with scrape type 2
2026-03-27 20:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5d0a2637-8e8c-51f1-bf6f-1e2ee81066ea, identifier: EZ95206
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_c0cb9998565d86ea1bc43acc2f9d9d69.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_c0cb9998565d86ea1bc43acc2f9d9d69.jpg not downloaded yet
2026-03-27 20:33:05 [auto1.be] INFO: Found listing with ID: UU52750
2026-03-27 20:33:05 [auto1.be] INFO: Found listing with ID: RA83369
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA83369%27 HTTP/1.1" 200 None
2026-03-27 20:33:05 [auto1.be] INFO: Scrape type for RA83369: 2
2026-03-27 20:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf951f9-5792-5dc2-bdd4-a36a1d555d27 with identifier: RA83369
2026-03-27 20:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf951f9-5792-5dc2-bdd4-a36a1d555d27 with scrape type 2
2026-03-27 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbf951f9-5792-5dc2-bdd4-a36a1d555d27 with scrape type 2
2026-03-27 20:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bbf951f9-5792-5dc2-bdd4-a36a1d555d27, identifier: RA83369
2026-03-27 20:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5d0a2637-8e8c-51f1-bf6f-1e2ee81066ea with identifier: EZ95206
2026-03-27 20:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5d0a2637-8e8c-51f1-bf6f-1e2ee81066ea with identifier: EZ95206
2026-03-27 20:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5d0a2637-8e8c-51f1-bf6f-1e2ee81066ea with identifier: EZ95206 to the API
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:09:14Z',
 'fuel_type': 'petrol',
 'id': '5d0a2637-8e8c-51f1-bf6f-1e2ee81066ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ95206',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 49272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2011}
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ95206%27 HTTP/1.1" 200 None
2026-03-27 20:33:06 [auto1.be] INFO: Saving data for EZ95206: {'auction_closing_time': 1774714154.0, 'created_time': 1773134973.982579, 'last_price_update_time': 1774643586.044557}
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EZ95206') HTTP/1.1" 204 0
2026-03-27 20:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bbf951f9-5792-5dc2-bdd4-a36a1d555d27 with identifier: RA83369
2026-03-27 20:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bbf951f9-5792-5dc2-bdd4-a36a1d555d27 with identifier: RA83369
2026-03-27 20:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bbf951f9-5792-5dc2-bdd4-a36a1d555d27 with identifier: RA83369 to the API
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-28T16:01:05Z',
 'fuel_type': 'hybrid',
 'id': 'bbf951f9-5792-5dc2-bdd4-a36a1d555d27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA83369',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'IONIQ',
 'odometer': 123159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-26',
 'seller_name': None,
 'title': 'Hyundai IONIQ 1.6 Hybrid Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2019}
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA83369%27 HTTP/1.1" 200 None
2026-03-27 20:33:06 [auto1.be] INFO: Saving data for RA83369: {'auction_closing_time': 1774713665.0, 'created_time': 1773238285.697808, 'last_price_update_time': 1774643586.412773}
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA83369') HTTP/1.1" 204 0
2026-03-27 20:33:06 [auto1.be] INFO: Found listing with ID: XZ13946
2026-03-27 20:33:06 [auto1.be] INFO: Found listing with ID: JC83971
2026-03-27 20:33:06 [auto1.be] INFO: Found listing with ID: AG12322
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG12322%27 HTTP/1.1" 200 None
2026-03-27 20:33:06 [auto1.be] INFO: Scrape type for AG12322: 2
2026-03-27 20:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c66ed0-1eec-50f2-bf2a-ecb4c985b959 with identifier: AG12322
2026-03-27 20:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c66ed0-1eec-50f2-bf2a-ecb4c985b959 with scrape type 2
2026-03-27 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6c66ed0-1eec-50f2-bf2a-ecb4c985b959 with scrape type 2
2026-03-27 20:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e6c66ed0-1eec-50f2-bf2a-ecb4c985b959, identifier: AG12322
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_c4881289d35d11045912af31222395e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_c4881289d35d11045912af31222395e6.jpg not downloaded yet
2026-03-27 20:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950
2026-03-27 20:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 648b6b51-4eac-5af1-9292-9a719642bc7d with scrape type 1
2026-03-27 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 648b6b51-4eac-5af1-9292-9a719642bc7d
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_5cd66124f796812729ff5e642526b8d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_5cd66124f796812729ff5e642526b8d8.jpg not downloaded yet
2026-03-27 20:33:06 [auto1.be] INFO: Found listing with ID: GE95300
2026-03-27 20:33:06 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-27 20:33:06 [auto1.be] INFO: Scrape type for DB21184: 2
2026-03-27 20:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184
2026-03-27 20:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with scrape type 2
2026-03-27 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with scrape type 2
2026-03-27 20:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 810a8a59-f990-5c63-bb42-8f748f7ec3d9, identifier: DB21184
2026-03-27 20:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e6c66ed0-1eec-50f2-bf2a-ecb4c985b959 with identifier: AG12322
2026-03-27 20:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e6c66ed0-1eec-50f2-bf2a-ecb4c985b959 with identifier: AG12322
2026-03-27 20:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e6c66ed0-1eec-50f2-bf2a-ecb4c985b959 with identifier: AG12322 to the API
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:03:46Z',
 'fuel_type': 'diesel',
 'id': 'e6c66ed0-1eec-50f2-bf2a-ecb4c985b959',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG12322',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 156427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-16',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG12322%27 HTTP/1.1" 200 None
2026-03-27 20:33:07 [auto1.be] INFO: Saving data for AG12322: {'auction_closing_time': 1774713826.0, 'created_time': 1773238553.522625, 'last_price_update_time': 1774643587.025301}
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AG12322') HTTP/1.1" 204 0
2026-03-27 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB94076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX99155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_373819cc0edc488e9cdb5af9b9f50f63.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:07 [scrapy.extensions.logstats] INFO: Crawled 116 pages (at 54 pages/min), scraped 239 items (at 113 items/min)
2026-03-27 20:33:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-27 20:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184
2026-03-27 20:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184
2026-03-27 20:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184 to the API
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:52:28Z',
 'fuel_type': 'diesel',
 'id': '810a8a59-f990-5c63-bb42-8f748f7ec3d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB21184',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 145380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-05',
 'seller_name': None,
 'title': 'BMW X2 sDrive 16d Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2019}
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-27 20:33:07 [auto1.be] INFO: Saving data for DB21184: {'auction_closing_time': 1774716748.0, 'created_time': 1773137053.882676, 'last_price_update_time': 1774643587.349137}
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB21184') HTTP/1.1" 204 0
2026-03-27 20:33:07 [auto1.be] INFO: Found listing with ID: VJ63338
2026-03-27 20:33:07 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-27 20:33:07 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-27 20:33:07 [auto1.be] INFO: Scrape type for SE12861: 1
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_6a508eb5b24e4e1bbb457de491237bc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_6a508eb5b24e4e1bbb457de491237bc4.jpg not downloaded yet
2026-03-27 20:33:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_badfe5db0715eeb2d8f6a21c0290443b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_badfe5db0715eeb2d8f6a21c0290443b.jpg not downloaded yet
2026-03-27 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ68976> (referer: https://www.auto1.com/v1/car-details-view/WJ68976/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY54111> (referer: https://www.auto1.com/v1/car-details-view/YY54111/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM27988> (referer: https://www.auto1.com/v1/car-details-view/GM27988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:07 [auto1.be] INFO: Found listing with ID: XN79579
2026-03-27 20:33:07 [auto1.be] INFO: Found listing with ID: WF25377
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF25377%27 HTTP/1.1" 200 None
2026-03-27 20:33:07 [auto1.be] INFO: Scrape type for WF25377: 2
2026-03-27 20:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d29bdf06-e04d-56fa-8021-61ec3d28b62e with identifier: WF25377
2026-03-27 20:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d29bdf06-e04d-56fa-8021-61ec3d28b62e with scrape type 2
2026-03-27 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d29bdf06-e04d-56fa-8021-61ec3d28b62e with scrape type 2
2026-03-27 20:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d29bdf06-e04d-56fa-8021-61ec3d28b62e, identifier: WF25377
2026-03-27 20:33:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP38676> (referer: https://www.auto1.com/v1/car-details-view/MP38676/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d29bdf06-e04d-56fa-8021-61ec3d28b62e with identifier: WF25377
2026-03-27 20:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d29bdf06-e04d-56fa-8021-61ec3d28b62e with identifier: WF25377
2026-03-27 20:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d29bdf06-e04d-56fa-8021-61ec3d28b62e with identifier: WF25377 to the API
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:00Z',
 'fuel_type': 'diesel',
 'id': 'd29bdf06-e04d-56fa-8021-61ec3d28b62e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF25377',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 220856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-04',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2016}
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF25377%27 HTTP/1.1" 200 None
2026-03-27 20:33:07 [auto1.be] INFO: Saving data for WF25377: {'auction_closing_time': 1774714260.0, 'created_time': 1773136099.266242, 'last_price_update_time': 1774643587.83632}
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WF25377') HTTP/1.1" 204 0
2026-03-27 20:33:07 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-27 20:33:07 [auto1.be] INFO: Scrape type for AW74184: 1
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_11f7d5162044966f23794e443892bb83.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_11f7d5162044966f23794e443892bb83.jpg not downloaded yet
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_f34b581b2bb884b6fedb4986711fb65a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_f34b581b2bb884b6fedb4986711fb65a.jpg not downloaded yet
2026-03-27 20:33:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:07 [auto1.be] INFO: Found listing with ID: UB54556
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB54556%27 HTTP/1.1" 200 None
2026-03-27 20:33:07 [auto1.be] INFO: Scrape type for UB54556: 2
2026-03-27 20:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d167f5b7-a7a0-59e3-ad55-58cc95a4765c with identifier: UB54556
2026-03-27 20:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d167f5b7-a7a0-59e3-ad55-58cc95a4765c with scrape type 2
2026-03-27 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d167f5b7-a7a0-59e3-ad55-58cc95a4765c with scrape type 2
2026-03-27 20:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d167f5b7-a7a0-59e3-ad55-58cc95a4765c, identifier: UB54556
2026-03-27 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a10b90>
2026-03-27 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_373819cc0edc488e9cdb5af9b9f50f63.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_373819cc0edc488e9cdb5af9b9f50f63.jpg saved to cache
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a67a2e3-1999-5e59-8375-d6e6c272134f
2026-03-27 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_5cd66124f796812729ff5e642526b8d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d167f5b7-a7a0-59e3-ad55-58cc95a4765c with identifier: UB54556
2026-03-27 20:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d167f5b7-a7a0-59e3-ad55-58cc95a4765c with identifier: UB54556
2026-03-27 20:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d167f5b7-a7a0-59e3-ad55-58cc95a4765c with identifier: UB54556 to the API
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:37:56Z',
 'fuel_type': 'diesel',
 'id': 'd167f5b7-a7a0-59e3-ad55-58cc95a4765c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB54556',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 104119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-23',
 'seller_name': None,
 'title': 'Audi Q7 50 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB54556%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [auto1.be] INFO: Saving data for UB54556: {'auction_closing_time': 1774715876.0, 'created_time': 1774471276.090892, 'last_price_update_time': 1774643588.307132}
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UB54556') HTTP/1.1" 204 0
2026-03-27 20:33:08 [auto1.be] INFO: Found listing with ID: KT11413
2026-03-27 20:33:08 [auto1.be] INFO: Found listing with ID: WN35442
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN35442%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [auto1.be] INFO: Scrape type for WN35442: 1
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_a90c038d43833bd11f442ae12c4f52f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_a90c038d43833bd11f442ae12c4f52f1.jpg not downloaded yet
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_5627ab3490be69743deddb91942b6564.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_5627ab3490be69743deddb91942b6564.jpg not downloaded yet
2026-03-27 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_c4881289d35d11045912af31222395e6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976
2026-03-27 20:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0fcadb-0820-5f2b-be46-a8cd384f0249 with scrape type 1
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd0fcadb-0820-5f2b-be46-a8cd384f0249
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe0%252F91e0bf3b2d693eed556f37f65173fdc8%252Fpa%252FWJ68976_eb00531f96d9c08d38a37a7914bec95a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_eb00531f96d9c08d38a37a7914bec95a.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe0%252F91e0bf3b2d693eed556f37f65173fdc8%252Fpa%252FWJ68976_f93610a2ffdec2d56dd478fab5e295aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_f93610a2ffdec2d56dd478fab5e295aa.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe0%252F91e0bf3b2d693eed556f37f65173fdc8%252Fpa%252FWJ68976_62fbe6f69afc2c68ccba4a72c4bacd45.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_62fbe6f69afc2c68ccba4a72c4bacd45.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe0%252F91e0bf3b2d693eed556f37f65173fdc8%252Fpa%252FWJ68976_b5870699780699e883ecf89b8929ee38.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_b5870699780699e883ecf89b8929ee38.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe0%252F91e0bf3b2d693eed556f37f65173fdc8%252Fpa%252FWJ68976_9680c9f8009f9df5b329141098d3106a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_9680c9f8009f9df5b329141098d3106a.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe0%252F91e0bf3b2d693eed556f37f65173fdc8%252Fpa%252FWJ68976_918a3b7d222f19897e84c3722dad71dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_918a3b7d222f19897e84c3722dad71dd.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe0%252F91e0bf3b2d693eed556f37f65173fdc8%252Fpa%252FWJ68976_8715ff821914d616d80dbaf426afd60b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_8715ff821914d616d80dbaf426afd60b.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe0%252F91e0bf3b2d693eed556f37f65173fdc8%252Fpa%252FWJ68976_d66b4515d4efdc29f0423f35a0e6e6e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_d66b4515d4efdc29f0423f35a0e6e6e2.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe0%252F91e0bf3b2d693eed556f37f65173fdc8%252Fpa%252FWJ68976_743df01ba32f1a0dbd2640e336f94bdf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_743df01ba32f1a0dbd2640e336f94bdf.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe0%252F91e0bf3b2d693eed556f37f65173fdc8%252Fpa%252FWJ68976_d91eafab6dc058f06953483abd896b5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_d91eafab6dc058f06953483abd896b5f.jpg already downloaded
2026-03-27 20:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd0fcadb-0820-5f2b-be46-a8cd384f0249, identifier: WJ68976
2026-03-27 20:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a23e178-2210-5b8c-bb3d-628d98d5e389 with identifier: YY54111
2026-03-27 20:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a23e178-2210-5b8c-bb3d-628d98d5e389 with scrape type 1
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a23e178-2210-5b8c-bb3d-628d98d5e389
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F23%252F11237d4f8669ff21e7e3447630bd538e%252Fpa%252FYY54111_133b70820a76c0680156aa701efdc804.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_133b70820a76c0680156aa701efdc804.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F23%252F11237d4f8669ff21e7e3447630bd538e%252Fpa%252FYY54111_1b6fa459ea0b8bc842fe329ab0a637de.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_1b6fa459ea0b8bc842fe329ab0a637de.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F23%252F11237d4f8669ff21e7e3447630bd538e%252Fpa%252FYY54111_c0f27350523d880c11f4cac634c49948.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_c0f27350523d880c11f4cac634c49948.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F23%252F11237d4f8669ff21e7e3447630bd538e%252Fpa%252FYY54111_c9a6bce1f2b478fedac4a0f9e49b6cf3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_c9a6bce1f2b478fedac4a0f9e49b6cf3.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F23%252F11237d4f8669ff21e7e3447630bd538e%252Fpa%252FYY54111_0457588897b181d54cbfda6222e58fdd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_0457588897b181d54cbfda6222e58fdd.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F23%252F11237d4f8669ff21e7e3447630bd538e%252Fpa%252FYY54111_44ed35f15439beaa473b18aafa64af2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_44ed35f15439beaa473b18aafa64af2f.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F23%252F11237d4f8669ff21e7e3447630bd538e%252Fpa%252FYY54111_ae359878c115e20dbe74ae982671c549.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_ae359878c115e20dbe74ae982671c549.jpg already downloaded
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F23%252F11237d4f8669ff21e7e3447630bd538e%252Fpa%252FYY54111_19f4ba6df4a8dd93a1d14e96a131e8dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_19f4ba6df4a8dd93a1d14e96a131e8dd.jpg not downloaded yet
2026-03-27 20:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f821651-613b-518e-8128-bcce8fc39a44 with identifier: GM27988
2026-03-27 20:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f821651-613b-518e-8128-bcce8fc39a44 with scrape type 1
2026-03-27 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f821651-613b-518e-8128-bcce8fc39a44
2026-03-27 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F89%252F19898e81b9bec0db8c7a3241c77cb4dc%252Fpa%252FGM27988_d223e7ac63e72db4440645fc21c23029.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_d223e7ac63e72db4440645fc21c23029.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F89%252F19898e81b9bec0db8c7a3241c77cb4dc%252Fpa%252FGM27988_27a9db03e2819ef784c00963347bb797.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_27a9db03e2819ef784c00963347bb797.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F89%252F19898e81b9bec0db8c7a3241c77cb4dc%252Fpa%252FGM27988_c48dac155f2c361cfbbfe2e24115920e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_c48dac155f2c361cfbbfe2e24115920e.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F89%252F19898e81b9bec0db8c7a3241c77cb4dc%252Fpa%252FGM27988_ab11eb5db416bb2770415db6858d34ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_ab11eb5db416bb2770415db6858d34ce.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F89%252F19898e81b9bec0db8c7a3241c77cb4dc%252Fpa%252FGM27988_ccb3fb52a43894f74bff500b59ccb056.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_ccb3fb52a43894f74bff500b59ccb056.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F89%252F19898e81b9bec0db8c7a3241c77cb4dc%252Fpa%252FGM27988_d90ccd80ced05e85fb9ee93ece18d002.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_d90ccd80ced05e85fb9ee93ece18d002.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F89%252F19898e81b9bec0db8c7a3241c77cb4dc%252Fpa%252FGM27988_0bbe8909402ee722e8cdace100930585.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_0bbe8909402ee722e8cdace100930585.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F89%252F19898e81b9bec0db8c7a3241c77cb4dc%252Fpa%252FGM27988_2b936f25fa3817a74cda61df852b9001.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_2b936f25fa3817a74cda61df852b9001.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F89%252F19898e81b9bec0db8c7a3241c77cb4dc%252Fpa%252FGM27988_f086c85fbe0e0923080daa8000f4fc03.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_f086c85fbe0e0923080daa8000f4fc03.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F89%252F19898e81b9bec0db8c7a3241c77cb4dc%252Fpa%252FGM27988_73f80edd252d7c58d546b843bbb1713f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_73f80edd252d7c58d546b843bbb1713f.jpg already downloaded
2026-03-27 20:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f821651-613b-518e-8128-bcce8fc39a44, identifier: GM27988
2026-03-27 20:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b695644-10d6-58b6-b1dc-4a576b32a9a2 with identifier: MP38676
2026-03-27 20:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b695644-10d6-58b6-b1dc-4a576b32a9a2 with scrape type 1
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b695644-10d6-58b6-b1dc-4a576b32a9a2
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Ff3%252F3bf3b47f23290a80fa9c6739822c213f%252Fpa%252FMP38676_ed954822697a85b4650a42180d4ba6cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_ed954822697a85b4650a42180d4ba6cc.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Ff3%252F3bf3b47f23290a80fa9c6739822c213f%252Fpa%252FMP38676_5478f76d8fd471be9e09296d7b2a4109.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_5478f76d8fd471be9e09296d7b2a4109.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Ff3%252F3bf3b47f23290a80fa9c6739822c213f%252Fpa%252FMP38676_7bc69b84b42111b0039f7bf60109bf69.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_7bc69b84b42111b0039f7bf60109bf69.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Ff3%252F3bf3b47f23290a80fa9c6739822c213f%252Fpa%252FMP38676_411c04846e540616102f23a4d66fb4f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_411c04846e540616102f23a4d66fb4f4.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Ff3%252F3bf3b47f23290a80fa9c6739822c213f%252Fpa%252FMP38676_3ba751a54d8f76e103423745519b9126.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_3ba751a54d8f76e103423745519b9126.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Ff3%252F3bf3b47f23290a80fa9c6739822c213f%252Fpa%252FMP38676_3ecaa651d5170ca15abde84fc9f9aed4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_3ecaa651d5170ca15abde84fc9f9aed4.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Ff3%252F3bf3b47f23290a80fa9c6739822c213f%252Fpa%252FMP38676_2d08ca82e56e8ae36cb61ad2e6977309.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_2d08ca82e56e8ae36cb61ad2e6977309.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Ff3%252F3bf3b47f23290a80fa9c6739822c213f%252Fpa%252FMP38676_795b65db75a21197c23bce4fa8ce31ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_795b65db75a21197c23bce4fa8ce31ef.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Ff3%252F3bf3b47f23290a80fa9c6739822c213f%252Fpa%252FMP38676_fd1ec51c9ca0b3813b1c468772763522.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_fd1ec51c9ca0b3813b1c468772763522.jpg already downloaded
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Ff3%252F3bf3b47f23290a80fa9c6739822c213f%252Fpa%252FMP38676_a55617d12377aaec46476e936aed1861.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_a55617d12377aaec46476e936aed1861.jpg already downloaded
2026-03-27 20:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8b695644-10d6-58b6-b1dc-4a576b32a9a2, identifier: MP38676
2026-03-27 20:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_badfe5db0715eeb2d8f6a21c0290443b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_c0cb9998565d86ea1bc43acc2f9d9d69.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_881511f86e95e4fe496cdc17043ab479.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:09 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-27 20:33:09 [auto1.be] INFO: Found listing with ID: HY09771
2026-03-27 20:33:09 [auto1.be] INFO: Found listing with ID: LB74355
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB74355%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [auto1.be] INFO: Scrape type for LB74355: 1
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_73bedf6e2275410b16adf39e44b875f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_73bedf6e2275410b16adf39e44b875f3.jpg not downloaded yet
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_bb176f20acc39474eb72cdb76f2b3ab6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_bb176f20acc39474eb72cdb76f2b3ab6.jpg not downloaded yet
2026-03-27 20:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976
2026-03-27 20:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976
2026-03-27 20:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976 to the API
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WJ68976>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:39:27Z',
 'fuel_type': 'petrol',
 'id': 'cd0fcadb-0820-5f2b-be46-a8cd384f0249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ68976',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'MINI',
 'model': 'Coupe',
 'odometer': 50580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_eb00531f96d9c08d38a37a7914bec95a.jpg',
                'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_f93610a2ffdec2d56dd478fab5e295aa.jpg',
                'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_62fbe6f69afc2c68ccba4a72c4bacd45.jpg',
                'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_b5870699780699e883ecf89b8929ee38.jpg',
                'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_9680c9f8009f9df5b329141098d3106a.jpg',
                'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_918a3b7d222f19897e84c3722dad71dd.jpg',
                'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_8715ff821914d616d80dbaf426afd60b.jpg',
                'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_d66b4515d4efdc29f0423f35a0e6e6e2.jpg',
                'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_743df01ba32f1a0dbd2640e336f94bdf.jpg',
                'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_d91eafab6dc058f06953483abd896b5f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0fcadb-0820-5f2b-be46-a8cd384f0249/cd0fcadb-0820-5f2b-be46-a8cd384f0249_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_eb00531f96d9c08d38a37a7914bec95a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0fcadb-0820-5f2b-be46-a8cd384f0249/cd0fcadb-0820-5f2b-be46-a8cd384f0249_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_f93610a2ffdec2d56dd478fab5e295aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0fcadb-0820-5f2b-be46-a8cd384f0249/cd0fcadb-0820-5f2b-be46-a8cd384f0249_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_62fbe6f69afc2c68ccba4a72c4bacd45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0fcadb-0820-5f2b-be46-a8cd384f0249/cd0fcadb-0820-5f2b-be46-a8cd384f0249_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_b5870699780699e883ecf89b8929ee38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0fcadb-0820-5f2b-be46-a8cd384f0249/cd0fcadb-0820-5f2b-be46-a8cd384f0249_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655555,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_9680c9f8009f9df5b329141098d3106a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0fcadb-0820-5f2b-be46-a8cd384f0249/cd0fcadb-0820-5f2b-be46-a8cd384f0249_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671334,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_918a3b7d222f19897e84c3722dad71dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0fcadb-0820-5f2b-be46-a8cd384f0249/cd0fcadb-0820-5f2b-be46-a8cd384f0249_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_8715ff821914d616d80dbaf426afd60b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0fcadb-0820-5f2b-be46-a8cd384f0249/cd0fcadb-0820-5f2b-be46-a8cd384f0249_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608473,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_d66b4515d4efdc29f0423f35a0e6e6e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0fcadb-0820-5f2b-be46-a8cd384f0249/cd0fcadb-0820-5f2b-be46-a8cd384f0249_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_743df01ba32f1a0dbd2640e336f94bdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd0fcadb-0820-5f2b-be46-a8cd384f0249/cd0fcadb-0820-5f2b-be46-a8cd384f0249_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e0/91e0bf3b2d693eed556f37f65173fdc8/pa/WJ68976_d91eafab6dc058f06953483abd896b5f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MINI Coupe Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-27 20:33:09 [auto1.be] INFO: Saving data for WJ68976: {'created_time': 1774643589.861876, 'last_price_update_time': 1774643589.861888, 'auction_closing_time': 1774715967.0}
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ68976') HTTP/1.1" 204 0
2026-03-27 20:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f821651-613b-518e-8128-bcce8fc39a44 with identifier: GM27988
2026-03-27 20:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f821651-613b-518e-8128-bcce8fc39a44 with identifier: GM27988
2026-03-27 20:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f821651-613b-518e-8128-bcce8fc39a44 with identifier: GM27988 to the API
2026-03-27 20:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GM27988>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:30:34Z',
 'fuel_type': 'petrol',
 'id': '2f821651-613b-518e-8128-bcce8fc39a44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM27988',
 'listing': 'auction',
 'location': 'BE',
 'make': 'BMW',
 'model': '4er',
 'odometer': 50445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_d223e7ac63e72db4440645fc21c23029.jpg',
                'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_27a9db03e2819ef784c00963347bb797.jpg',
                'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_c48dac155f2c361cfbbfe2e24115920e.jpg',
                'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_ab11eb5db416bb2770415db6858d34ce.jpg',
                'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_ccb3fb52a43894f74bff500b59ccb056.jpg',
                'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_d90ccd80ced05e85fb9ee93ece18d002.jpg',
                'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_0bbe8909402ee722e8cdace100930585.jpg',
                'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_2b936f25fa3817a74cda61df852b9001.jpg',
                'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_f086c85fbe0e0923080daa8000f4fc03.jpg',
                'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_73f80edd252d7c58d546b843bbb1713f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f821651-613b-518e-8128-bcce8fc39a44/2f821651-613b-518e-8128-bcce8fc39a44_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_d223e7ac63e72db4440645fc21c23029.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f821651-613b-518e-8128-bcce8fc39a44/2f821651-613b-518e-8128-bcce8fc39a44_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_27a9db03e2819ef784c00963347bb797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f821651-613b-518e-8128-bcce8fc39a44/2f821651-613b-518e-8128-bcce8fc39a44_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_c48dac155f2c361cfbbfe2e24115920e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f821651-613b-518e-8128-bcce8fc39a44/2f821651-613b-518e-8128-bcce8fc39a44_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_ab11eb5db416bb2770415db6858d34ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f821651-613b-518e-8128-bcce8fc39a44/2f821651-613b-518e-8128-bcce8fc39a44_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_ccb3fb52a43894f74bff500b59ccb056.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f821651-613b-518e-8128-bcce8fc39a44/2f821651-613b-518e-8128-bcce8fc39a44_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_d90ccd80ced05e85fb9ee93ece18d002.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f821651-613b-518e-8128-bcce8fc39a44/2f821651-613b-518e-8128-bcce8fc39a44_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_0bbe8909402ee722e8cdace100930585.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f821651-613b-518e-8128-bcce8fc39a44/2f821651-613b-518e-8128-bcce8fc39a44_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_2b936f25fa3817a74cda61df852b9001.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f821651-613b-518e-8128-bcce8fc39a44/2f821651-613b-518e-8128-bcce8fc39a44_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_f086c85fbe0e0923080daa8000f4fc03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f821651-613b-518e-8128-bcce8fc39a44/2f821651-613b-518e-8128-bcce8fc39a44_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/89/19898e81b9bec0db8c7a3241c77cb4dc/pa/GM27988_73f80edd252d7c58d546b843bbb1713f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 4er 430i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2022}
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM27988%27 HTTP/1.1" 200 None
2026-03-27 20:33:10 [auto1.be] INFO: Saving data for GM27988: {'created_time': 1774643590.146282, 'last_price_update_time': 1774643590.146294, 'auction_closing_time': 1774715434.0}
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GM27988') HTTP/1.1" 204 0
2026-03-27 20:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8b695644-10d6-58b6-b1dc-4a576b32a9a2 with identifier: MP38676
2026-03-27 20:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8b695644-10d6-58b6-b1dc-4a576b32a9a2 with identifier: MP38676
2026-03-27 20:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8b695644-10d6-58b6-b1dc-4a576b32a9a2 with identifier: MP38676 to the API
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MP38676>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:19:25Z',
 'fuel_type': 'diesel',
 'id': '8b695644-10d6-58b6-b1dc-4a576b32a9a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP38676',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 88552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_ed954822697a85b4650a42180d4ba6cc.jpg',
                'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_5478f76d8fd471be9e09296d7b2a4109.jpg',
                'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_7bc69b84b42111b0039f7bf60109bf69.jpg',
                'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_411c04846e540616102f23a4d66fb4f4.jpg',
                'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_3ba751a54d8f76e103423745519b9126.jpg',
                'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_3ecaa651d5170ca15abde84fc9f9aed4.jpg',
                'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_2d08ca82e56e8ae36cb61ad2e6977309.jpg',
                'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_795b65db75a21197c23bce4fa8ce31ef.jpg',
                'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_fd1ec51c9ca0b3813b1c468772763522.jpg',
                'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_a55617d12377aaec46476e936aed1861.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b695644-10d6-58b6-b1dc-4a576b32a9a2/8b695644-10d6-58b6-b1dc-4a576b32a9a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_ed954822697a85b4650a42180d4ba6cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b695644-10d6-58b6-b1dc-4a576b32a9a2/8b695644-10d6-58b6-b1dc-4a576b32a9a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_5478f76d8fd471be9e09296d7b2a4109.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b695644-10d6-58b6-b1dc-4a576b32a9a2/8b695644-10d6-58b6-b1dc-4a576b32a9a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_7bc69b84b42111b0039f7bf60109bf69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b695644-10d6-58b6-b1dc-4a576b32a9a2/8b695644-10d6-58b6-b1dc-4a576b32a9a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_411c04846e540616102f23a4d66fb4f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b695644-10d6-58b6-b1dc-4a576b32a9a2/8b695644-10d6-58b6-b1dc-4a576b32a9a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_3ba751a54d8f76e103423745519b9126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b695644-10d6-58b6-b1dc-4a576b32a9a2/8b695644-10d6-58b6-b1dc-4a576b32a9a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_3ecaa651d5170ca15abde84fc9f9aed4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b695644-10d6-58b6-b1dc-4a576b32a9a2/8b695644-10d6-58b6-b1dc-4a576b32a9a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_2d08ca82e56e8ae36cb61ad2e6977309.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b695644-10d6-58b6-b1dc-4a576b32a9a2/8b695644-10d6-58b6-b1dc-4a576b32a9a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_795b65db75a21197c23bce4fa8ce31ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b695644-10d6-58b6-b1dc-4a576b32a9a2/8b695644-10d6-58b6-b1dc-4a576b32a9a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_fd1ec51c9ca0b3813b1c468772763522.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b695644-10d6-58b6-b1dc-4a576b32a9a2/8b695644-10d6-58b6-b1dc-4a576b32a9a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/f3/3bf3b47f23290a80fa9c6739822c213f/pa/MP38676_a55617d12377aaec46476e936aed1861.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 35 TDI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP38676%27 HTTP/1.1" 200 None
2026-03-27 20:33:10 [auto1.be] INFO: Saving data for MP38676: {'created_time': 1774643590.440539, 'last_price_update_time': 1774643590.440549, 'auction_closing_time': 1774714765.0}
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MP38676') HTTP/1.1" 204 0
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F23%252F11237d4f8669ff21e7e3447630bd538e%252Fpa%252FYY54111_f9e6da512025bb27f11671228bb4f95d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_f9e6da512025bb27f11671228bb4f95d.jpg already downloaded
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F23%252F11237d4f8669ff21e7e3447630bd538e%252Fpa%252FYY54111_5eaa7051ff091cb08791f2096374f69a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_5eaa7051ff091cb08791f2096374f69a.jpg already downloaded
2026-03-27 20:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529c2550>
2026-03-27 20:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_5cd66124f796812729ff5e642526b8d8.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_5cd66124f796812729ff5e642526b8d8.jpg saved to cache
2026-03-27 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 648b6b51-4eac-5af1-9292-9a719642bc7d
2026-03-27 20:33:10 [auto1.be] INFO: Found listing with ID: YD33796
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD33796%27 HTTP/1.1" 200 None
2026-03-27 20:33:10 [auto1.be] INFO: Scrape type for YD33796: 2
2026-03-27 20:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebfb9bfc-1435-575a-8097-4301206fd6ad with identifier: YD33796
2026-03-27 20:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebfb9bfc-1435-575a-8097-4301206fd6ad with scrape type 2
2026-03-27 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebfb9bfc-1435-575a-8097-4301206fd6ad with scrape type 2
2026-03-27 20:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ebfb9bfc-1435-575a-8097-4301206fd6ad, identifier: YD33796
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_b880e9cd0ffc6c536c3085c23ec20786.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_b880e9cd0ffc6c536c3085c23ec20786.jpg not downloaded yet
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_d0bd30a4d84a208b90c11ca679b93885.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_d0bd30a4d84a208b90c11ca679b93885.jpg not downloaded yet
2026-03-27 20:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW19159> (referer: https://www.auto1.com/v1/car-details-view/JW19159/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ebfb9bfc-1435-575a-8097-4301206fd6ad with identifier: YD33796
2026-03-27 20:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ebfb9bfc-1435-575a-8097-4301206fd6ad with identifier: YD33796
2026-03-27 20:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ebfb9bfc-1435-575a-8097-4301206fd6ad with identifier: YD33796 to the API
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:33:16Z',
 'fuel_type': 'diesel',
 'id': 'ebfb9bfc-1435-575a-8097-4301206fd6ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD33796',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 159746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-27',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2017}
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD33796%27 HTTP/1.1" 200 None
2026-03-27 20:33:10 [auto1.be] INFO: Saving data for YD33796: {'auction_closing_time': 1774715596.0, 'created_time': 1773238728.071137, 'last_price_update_time': 1774643590.985244}
2026-03-27 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YD33796') HTTP/1.1" 204 0
2026-03-27 20:33:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35353a050>
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_c4881289d35d11045912af31222395e6.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_c4881289d35d11045912af31222395e6.jpg saved to cache
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a67a2e3-1999-5e59-8375-d6e6c272134f
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35299ac10>
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_badfe5db0715eeb2d8f6a21c0290443b.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_badfe5db0715eeb2d8f6a21c0290443b.jpg saved to cache
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 648b6b51-4eac-5af1-9292-9a719642bc7d
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529a2f90>
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_c0cb9998565d86ea1bc43acc2f9d9d69.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_c0cb9998565d86ea1bc43acc2f9d9d69.jpg saved to cache
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a67a2e3-1999-5e59-8375-d6e6c272134f
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529f7650>
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_881511f86e95e4fe496cdc17043ab479.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_881511f86e95e4fe496cdc17043ab479.jpg saved to cache
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a67a2e3-1999-5e59-8375-d6e6c272134f
2026-03-27 20:33:11 [auto1.be] INFO: Found listing with ID: FY16186
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY16186%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [auto1.be] INFO: Scrape type for FY16186: 2
2026-03-27 20:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c112996-342c-56e6-9705-a3e7e5e695b1 with identifier: FY16186
2026-03-27 20:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c112996-342c-56e6-9705-a3e7e5e695b1 with scrape type 2
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c112996-342c-56e6-9705-a3e7e5e695b1 with scrape type 2
2026-03-27 20:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c112996-342c-56e6-9705-a3e7e5e695b1, identifier: FY16186
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_fd71a4c9afb646ad1f57eaff18838021.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_fd71a4c9afb646ad1f57eaff18838021.jpg not downloaded yet
2026-03-27 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_5627ab3490be69743deddb91942b6564.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_a90c038d43833bd11f442ae12c4f52f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c112996-342c-56e6-9705-a3e7e5e695b1 with identifier: FY16186
2026-03-27 20:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c112996-342c-56e6-9705-a3e7e5e695b1 with identifier: FY16186
2026-03-27 20:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c112996-342c-56e6-9705-a3e7e5e695b1 with identifier: FY16186 to the API
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:56:42Z',
 'fuel_type': 'diesel',
 'id': '7c112996-342c-56e6-9705-a3e7e5e695b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY16186',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 85525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.5 CDTI GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2021}
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY16186%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [auto1.be] INFO: Saving data for FY16186: {'auction_closing_time': 1774717002.0, 'created_time': 1773225575.444579, 'last_price_update_time': 1774643591.609709}
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY16186') HTTP/1.1" 204 0
2026-03-27 20:33:11 [auto1.be] INFO: Found listing with ID: MA85452
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA85452%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [auto1.be] INFO: Scrape type for MA85452: 2
2026-03-27 20:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75600a55-abdc-5877-806d-5b27e1bb273a with identifier: MA85452
2026-03-27 20:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75600a55-abdc-5877-806d-5b27e1bb273a with scrape type 2
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75600a55-abdc-5877-806d-5b27e1bb273a with scrape type 2
2026-03-27 20:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 75600a55-abdc-5877-806d-5b27e1bb273a, identifier: MA85452
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_0f0c844d94130276a7fbc75ea734baec.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_0f0c844d94130276a7fbc75ea734baec.jpg not downloaded yet
2026-03-27 20:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98c6f95f-418d-50b3-888d-de84bc8ad41f with identifier: JW19159
2026-03-27 20:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c6f95f-418d-50b3-888d-de84bc8ad41f with scrape type 1
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98c6f95f-418d-50b3-888d-de84bc8ad41f
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F85%252F3885ac545b775ea99a6964ded7dfaf1b%252Fpa%252FJW19159_12bb2590f612307cfdfcd25c929d0f2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_12bb2590f612307cfdfcd25c929d0f2f.jpg already downloaded
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F85%252F3885ac545b775ea99a6964ded7dfaf1b%252Fpa%252FJW19159_777e6d805a682c18c4ca200d18e27a2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_777e6d805a682c18c4ca200d18e27a2d.jpg already downloaded
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F85%252F3885ac545b775ea99a6964ded7dfaf1b%252Fpa%252FJW19159_79a6174d7195b77d0aa65ce1da50d62f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_79a6174d7195b77d0aa65ce1da50d62f.jpg already downloaded
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F85%252F3885ac545b775ea99a6964ded7dfaf1b%252Fpa%252FJW19159_293bb672c94bd62ddb7a550d7f7ea762.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_293bb672c94bd62ddb7a550d7f7ea762.jpg already downloaded
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F85%252F3885ac545b775ea99a6964ded7dfaf1b%252Fpa%252FJW19159_d5d7cceb552908c70d58557ab29ab2f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_d5d7cceb552908c70d58557ab29ab2f0.jpg already downloaded
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F85%252F3885ac545b775ea99a6964ded7dfaf1b%252Fpa%252FJW19159_951ed9033fe0320d513f99c03d2a31be.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_951ed9033fe0320d513f99c03d2a31be.jpg already downloaded
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F85%252F3885ac545b775ea99a6964ded7dfaf1b%252Fpa%252FJW19159_b529b831a7368827231aac40bcc78c0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_b529b831a7368827231aac40bcc78c0e.jpg already downloaded
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F85%252F3885ac545b775ea99a6964ded7dfaf1b%252Fpa%252FJW19159_d5b1e693603e98057b127271a036ab25.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_d5b1e693603e98057b127271a036ab25.jpg already downloaded
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F85%252F3885ac545b775ea99a6964ded7dfaf1b%252Fpa%252FJW19159_1380b57b51ca976228d910c7557c4771.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_1380b57b51ca976228d910c7557c4771.jpg already downloaded
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F85%252F3885ac545b775ea99a6964ded7dfaf1b%252Fpa%252FJW19159_6969e1cbaff17470d8c8ebd6ba8bb959.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_6969e1cbaff17470d8c8ebd6ba8bb959.jpg already downloaded
2026-03-27 20:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 98c6f95f-418d-50b3-888d-de84bc8ad41f, identifier: JW19159
2026-03-27 20:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_bb176f20acc39474eb72cdb76f2b3ab6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 75600a55-abdc-5877-806d-5b27e1bb273a with identifier: MA85452
2026-03-27 20:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 75600a55-abdc-5877-806d-5b27e1bb273a with identifier: MA85452
2026-03-27 20:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 75600a55-abdc-5877-806d-5b27e1bb273a with identifier: MA85452 to the API
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:38:18Z',
 'fuel_type': 'petrol',
 'id': '75600a55-abdc-5877-806d-5b27e1bb273a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA85452',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 147550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-24',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA85452%27 HTTP/1.1" 200 None
2026-03-27 20:33:12 [auto1.be] INFO: Saving data for MA85452: {'auction_closing_time': 1774715898.0, 'created_time': 1773133809.384184, 'last_price_update_time': 1774643592.335333}
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MA85452') HTTP/1.1" 204 0
2026-03-27 20:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB55851/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 98c6f95f-418d-50b3-888d-de84bc8ad41f with identifier: JW19159
2026-03-27 20:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 98c6f95f-418d-50b3-888d-de84bc8ad41f with identifier: JW19159
2026-03-27 20:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 98c6f95f-418d-50b3-888d-de84bc8ad41f with identifier: JW19159 to the API
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JW19159>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:38:43Z',
 'fuel_type': 'petrol',
 'id': '98c6f95f-418d-50b3-888d-de84bc8ad41f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW19159',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 58206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_12bb2590f612307cfdfcd25c929d0f2f.jpg',
                'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_777e6d805a682c18c4ca200d18e27a2d.jpg',
                'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_79a6174d7195b77d0aa65ce1da50d62f.jpg',
                'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_293bb672c94bd62ddb7a550d7f7ea762.jpg',
                'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_d5d7cceb552908c70d58557ab29ab2f0.jpg',
                'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_951ed9033fe0320d513f99c03d2a31be.jpg',
                'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_b529b831a7368827231aac40bcc78c0e.jpg',
                'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_d5b1e693603e98057b127271a036ab25.jpg',
                'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_1380b57b51ca976228d910c7557c4771.jpg',
                'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_6969e1cbaff17470d8c8ebd6ba8bb959.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c6f95f-418d-50b3-888d-de84bc8ad41f/98c6f95f-418d-50b3-888d-de84bc8ad41f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_12bb2590f612307cfdfcd25c929d0f2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c6f95f-418d-50b3-888d-de84bc8ad41f/98c6f95f-418d-50b3-888d-de84bc8ad41f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_777e6d805a682c18c4ca200d18e27a2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c6f95f-418d-50b3-888d-de84bc8ad41f/98c6f95f-418d-50b3-888d-de84bc8ad41f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_79a6174d7195b77d0aa65ce1da50d62f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c6f95f-418d-50b3-888d-de84bc8ad41f/98c6f95f-418d-50b3-888d-de84bc8ad41f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_293bb672c94bd62ddb7a550d7f7ea762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c6f95f-418d-50b3-888d-de84bc8ad41f/98c6f95f-418d-50b3-888d-de84bc8ad41f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_d5d7cceb552908c70d58557ab29ab2f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c6f95f-418d-50b3-888d-de84bc8ad41f/98c6f95f-418d-50b3-888d-de84bc8ad41f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_951ed9033fe0320d513f99c03d2a31be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c6f95f-418d-50b3-888d-de84bc8ad41f/98c6f95f-418d-50b3-888d-de84bc8ad41f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_b529b831a7368827231aac40bcc78c0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c6f95f-418d-50b3-888d-de84bc8ad41f/98c6f95f-418d-50b3-888d-de84bc8ad41f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_d5b1e693603e98057b127271a036ab25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c6f95f-418d-50b3-888d-de84bc8ad41f/98c6f95f-418d-50b3-888d-de84bc8ad41f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_1380b57b51ca976228d910c7557c4771.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c6f95f-418d-50b3-888d-de84bc8ad41f/98c6f95f-418d-50b3-888d-de84bc8ad41f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/85/3885ac545b775ea99a6964ded7dfaf1b/pa/JW19159_6969e1cbaff17470d8c8ebd6ba8bb959.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2017}
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW19159%27 HTTP/1.1" 200 None
2026-03-27 20:33:12 [auto1.be] INFO: Saving data for JW19159: {'created_time': 1774643592.675153, 'last_price_update_time': 1774643592.675164, 'auction_closing_time': 1774715923.0}
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW19159') HTTP/1.1" 204 0
2026-03-27 20:33:12 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-27 20:33:12 [auto1.be] INFO: Scrape type for LE91648: 2
2026-03-27 20:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648
2026-03-27 20:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1efb1a35-4c8a-549d-941c-7eb47a31c85b with scrape type 2
2026-03-27 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1efb1a35-4c8a-549d-941c-7eb47a31c85b with scrape type 2
2026-03-27 20:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1efb1a35-4c8a-549d-941c-7eb47a31c85b, identifier: LE91648
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_edae8fabc9ba7153a6288a2468f6bbc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_edae8fabc9ba7153a6288a2468f6bbc2.jpg not downloaded yet
2026-03-27 20:33:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP39108/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT26763> (referer: https://www.auto1.com/v1/car-details-view/PT26763/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY03378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC14202/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ae3bd0>
2026-03-27 20:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_5627ab3490be69743deddb91942b6564.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_5627ab3490be69743deddb91942b6564.jpg saved to cache
2026-03-27 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 648b6b51-4eac-5af1-9292-9a719642bc7d
2026-03-27 20:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3528051d0>
2026-03-27 20:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_a90c038d43833bd11f442ae12c4f52f1.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_a90c038d43833bd11f442ae12c4f52f1.jpg saved to cache
2026-03-27 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a67a2e3-1999-5e59-8375-d6e6c272134f
2026-03-27 20:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648
2026-03-27 20:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648
2026-03-27 20:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648 to the API
2026-03-27 20:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:27:47Z',
 'fuel_type': 'diesel',
 'id': '1efb1a35-4c8a-549d-941c-7eb47a31c85b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE91648',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 122827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-03',
 'seller_name': None,
 'title': 'BMW 3er 320d GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-27 20:33:13 [auto1.be] INFO: Saving data for LE91648: {'auction_closing_time': 1774715267.0, 'created_time': 1773136989.3621, 'last_price_update_time': 1774643593.193289}
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE91648') HTTP/1.1" 204 0
2026-03-27 20:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC96921/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_fd71a4c9afb646ad1f57eaff18838021.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:13 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-27 20:33:13 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-27 20:33:13 [auto1.be] INFO: Scrape type for FH50113: 2
2026-03-27 20:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113
2026-03-27 20:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e45de4-37f4-506a-974d-f4c70084e437 with scrape type 2
2026-03-27 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e45de4-37f4-506a-974d-f4c70084e437 with scrape type 2
2026-03-27 20:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 61e45de4-37f4-506a-974d-f4c70084e437, identifier: FH50113
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_615e6742a4fcfde871990935da0b3a29.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_615e6742a4fcfde871990935da0b3a29.jpg not downloaded yet
2026-03-27 20:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV05904/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529ee4d0>
2026-03-27 20:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_bb176f20acc39474eb72cdb76f2b3ab6.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_bb176f20acc39474eb72cdb76f2b3ab6.jpg saved to cache
2026-03-27 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 648b6b51-4eac-5af1-9292-9a719642bc7d
2026-03-27 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_d0bd30a4d84a208b90c11ca679b93885.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113
2026-03-27 20:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113
2026-03-27 20:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113 to the API
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-28T16:07:21Z',
 'fuel_type': 'petrol',
 'id': '61e45de4-37f4-506a-974d-f4c70084e437',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH50113',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 65446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-30',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-27 20:33:13 [auto1.be] INFO: Saving data for FH50113: {'auction_closing_time': 1774714041.0, 'created_time': 1773133772.464527, 'last_price_update_time': 1774643593.773187}
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FH50113') HTTP/1.1" 204 0
2026-03-27 20:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_b880e9cd0ffc6c536c3085c23ec20786.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:13 [auto1.be] INFO: Found listing with ID: UJ35064
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ35064%27 HTTP/1.1" 200 None
2026-03-27 20:33:13 [auto1.be] INFO: Scrape type for UJ35064: 2
2026-03-27 20:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a40dc32-e8ee-5f88-bac9-bc3b3f8e4be4 with identifier: UJ35064
2026-03-27 20:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a40dc32-e8ee-5f88-bac9-bc3b3f8e4be4 with scrape type 2
2026-03-27 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a40dc32-e8ee-5f88-bac9-bc3b3f8e4be4 with scrape type 2
2026-03-27 20:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a40dc32-e8ee-5f88-bac9-bc3b3f8e4be4, identifier: UJ35064
2026-03-27 20:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763
2026-03-27 20:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587ea13f-532d-5194-a614-83d6c952f2dc with scrape type 1
2026-03-27 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 587ea13f-532d-5194-a614-83d6c952f2dc
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_a929567275a4f505faea9a75e639bd69.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_a929567275a4f505faea9a75e639bd69.jpg not downloaded yet
2026-03-27 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_0f0c844d94130276a7fbc75ea734baec.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_f34b581b2bb884b6fedb4986711fb65a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a40dc32-e8ee-5f88-bac9-bc3b3f8e4be4 with identifier: UJ35064
2026-03-27 20:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a40dc32-e8ee-5f88-bac9-bc3b3f8e4be4 with identifier: UJ35064
2026-03-27 20:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a40dc32-e8ee-5f88-bac9-bc3b3f8e4be4 with identifier: UJ35064 to the API
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:46:16Z',
 'fuel_type': 'diesel',
 'id': '5a40dc32-e8ee-5f88-bac9-bc3b3f8e4be4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ35064',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 211211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-06',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Summum 2WD',
 'transmission': 'automatic',
 'trim': 'Summum 2WD',
 'year': 2013}
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ35064%27 HTTP/1.1" 200 None
2026-03-27 20:33:14 [auto1.be] INFO: Saving data for UJ35064: {'auction_closing_time': 1774716376.0, 'created_time': 1773238805.208732, 'last_price_update_time': 1774643594.279701}
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UJ35064') HTTP/1.1" 204 0
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352935b10>
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_fd71a4c9afb646ad1f57eaff18838021.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_fd71a4c9afb646ad1f57eaff18838021.jpg saved to cache
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 648b6b51-4eac-5af1-9292-9a719642bc7d
2026-03-27 20:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_19f4ba6df4a8dd93a1d14e96a131e8dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_73bedf6e2275410b16adf39e44b875f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:14 [auto1.be] INFO: Found listing with ID: FJ75207
2026-03-27 20:33:14 [auto1.be] INFO: Found listing with ID: EL87249
2026-03-27 20:33:14 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-27 20:33:14 [auto1.be] INFO: Scrape type for TV22564: 2
2026-03-27 20:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564
2026-03-27 20:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b075b720-14d8-560d-9ac6-feeca91fea2b with scrape type 2
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b075b720-14d8-560d-9ac6-feeca91fea2b with scrape type 2
2026-03-27 20:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b075b720-14d8-560d-9ac6-feeca91fea2b, identifier: TV22564
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_c8b7a6907748ca772e2610a7dd84cb44.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_c8b7a6907748ca772e2610a7dd84cb44.jpg not downloaded yet
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35291e5d0>
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_d0bd30a4d84a208b90c11ca679b93885.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_d0bd30a4d84a208b90c11ca679b93885.jpg saved to cache
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 648b6b51-4eac-5af1-9292-9a719642bc7d
2026-03-27 20:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_edae8fabc9ba7153a6288a2468f6bbc2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_11f7d5162044966f23794e443892bb83.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564
2026-03-27 20:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564
2026-03-27 20:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564 to the API
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:27:39Z',
 'fuel_type': 'diesel',
 'id': 'b075b720-14d8-560d-9ac6-feeca91fea2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV22564',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 189507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-24',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2011}
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-27 20:33:14 [auto1.be] INFO: Saving data for TV22564: {'auction_closing_time': 1774715259.0, 'created_time': 1773237825.833481, 'last_price_update_time': 1774643594.760665}
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TV22564') HTTP/1.1" 204 0
2026-03-27 20:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_6a508eb5b24e4e1bbb457de491237bc4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:14 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-27 20:33:14 [auto1.be] INFO: Found listing with ID: UD25678
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD25678%27 HTTP/1.1" 200 None
2026-03-27 20:33:14 [auto1.be] INFO: Scrape type for UD25678: 1
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_044c2fb297ce5cc7608d827dbee0ff5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_044c2fb297ce5cc7608d827dbee0ff5a.jpg not downloaded yet
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35291e990>
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_b880e9cd0ffc6c536c3085c23ec20786.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_b880e9cd0ffc6c536c3085c23ec20786.jpg saved to cache
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a67a2e3-1999-5e59-8375-d6e6c272134f
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534ac910>
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_0f0c844d94130276a7fbc75ea734baec.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_0f0c844d94130276a7fbc75ea734baec.jpg saved to cache
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 648b6b51-4eac-5af1-9292-9a719642bc7d
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353575010>
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_f34b581b2bb884b6fedb4986711fb65a.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_f34b581b2bb884b6fedb4986711fb65a.jpg saved to cache
2026-03-27 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 648b6b51-4eac-5af1-9292-9a719642bc7d
2026-03-27 20:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_615e6742a4fcfde871990935da0b3a29.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:14 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-27 20:33:14 [auto1.be] INFO: Scrape type for ME81448: 1
2026-03-27 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_331df7c6619e46148823a62c9f5ca9c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_331df7c6619e46148823a62c9f5ca9c5.jpg not downloaded yet
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b2b750>
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a23e178-2210-5b8c-bb3d-628d98d5e389/2a23e178-2210-5b8c-bb3d-628d98d5e389_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F23%252F11237d4f8669ff21e7e3447630bd538e%252Fpa%252FYY54111_19f4ba6df4a8dd93a1d14e96a131e8dd.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_19f4ba6df4a8dd93a1d14e96a131e8dd.jpg saved to cache
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a23e178-2210-5b8c-bb3d-628d98d5e389
2026-03-27 20:33:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a23e178-2210-5b8c-bb3d-628d98d5e389, skipping ID generation
2026-03-27 20:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a23e178-2210-5b8c-bb3d-628d98d5e389 with scrape type 1
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a23e178-2210-5b8c-bb3d-628d98d5e389 sending to next pipeline
2026-03-27 20:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a23e178-2210-5b8c-bb3d-628d98d5e389, identifier: YY54111
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534af990>
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_73bedf6e2275410b16adf39e44b875f3.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_73bedf6e2275410b16adf39e44b875f3.jpg saved to cache
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a67a2e3-1999-5e59-8375-d6e6c272134f
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b28350>
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_edae8fabc9ba7153a6288a2468f6bbc2.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_edae8fabc9ba7153a6288a2468f6bbc2.jpg saved to cache
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 648b6b51-4eac-5af1-9292-9a719642bc7d
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35357d110>
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_11f7d5162044966f23794e443892bb83.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_11f7d5162044966f23794e443892bb83.jpg saved to cache
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a67a2e3-1999-5e59-8375-d6e6c272134f
2026-03-27 20:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a23e178-2210-5b8c-bb3d-628d98d5e389 with identifier: YY54111
2026-03-27 20:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a23e178-2210-5b8c-bb3d-628d98d5e389 with identifier: YY54111
2026-03-27 20:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a23e178-2210-5b8c-bb3d-628d98d5e389 with identifier: YY54111 to the API
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_19f4ba6df4a8dd93a1d14e96a131e8dd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:22:40Z',
 'fuel_type': 'diesel',
 'id': '2a23e178-2210-5b8c-bb3d-628d98d5e389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY54111',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 153654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a23e178-2210-5b8c-bb3d-628d98d5e389/2a23e178-2210-5b8c-bb3d-628d98d5e389_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_133b70820a76c0680156aa701efdc804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a23e178-2210-5b8c-bb3d-628d98d5e389/2a23e178-2210-5b8c-bb3d-628d98d5e389_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_1b6fa459ea0b8bc842fe329ab0a637de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a23e178-2210-5b8c-bb3d-628d98d5e389/2a23e178-2210-5b8c-bb3d-628d98d5e389_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_c0f27350523d880c11f4cac634c49948.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a23e178-2210-5b8c-bb3d-628d98d5e389/2a23e178-2210-5b8c-bb3d-628d98d5e389_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_c9a6bce1f2b478fedac4a0f9e49b6cf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a23e178-2210-5b8c-bb3d-628d98d5e389/2a23e178-2210-5b8c-bb3d-628d98d5e389_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_0457588897b181d54cbfda6222e58fdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a23e178-2210-5b8c-bb3d-628d98d5e389/2a23e178-2210-5b8c-bb3d-628d98d5e389_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_44ed35f15439beaa473b18aafa64af2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a23e178-2210-5b8c-bb3d-628d98d5e389/2a23e178-2210-5b8c-bb3d-628d98d5e389_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_ae359878c115e20dbe74ae982671c549.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a23e178-2210-5b8c-bb3d-628d98d5e389/2a23e178-2210-5b8c-bb3d-628d98d5e389_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_19f4ba6df4a8dd93a1d14e96a131e8dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a23e178-2210-5b8c-bb3d-628d98d5e389/2a23e178-2210-5b8c-bb3d-628d98d5e389_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_f9e6da512025bb27f11671228bb4f95d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a23e178-2210-5b8c-bb3d-628d98d5e389/2a23e178-2210-5b8c-bb3d-628d98d5e389_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/23/11237d4f8669ff21e7e3447630bd538e/pa/YY54111_5eaa7051ff091cb08791f2096374f69a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 35 TDI quattro Business Executive',
 'transmission': 'automatic',
 'trim': 'quattro Business Executive',
 'year': 2020}
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY54111%27 HTTP/1.1" 200 None
2026-03-27 20:33:15 [auto1.be] INFO: Saving data for YY54111: {'created_time': 1774643595.524328, 'last_price_update_time': 1774643595.524339, 'auction_closing_time': 1774714960.0}
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YY54111') HTTP/1.1" 204 0
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35367a590>
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_6a508eb5b24e4e1bbb457de491237bc4.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_6a508eb5b24e4e1bbb457de491237bc4.jpg saved to cache
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a67a2e3-1999-5e59-8375-d6e6c272134f
2026-03-27 20:33:15 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-27 20:33:15 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-27 20:33:15 [auto1.be] INFO: Scrape type for XN92471: 1
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_8512b6849df3e5b97c9dfcf5734a3a8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_8512b6849df3e5b97c9dfcf5734a3a8b.jpg not downloaded yet
2026-03-27 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_c8b7a6907748ca772e2610a7dd84cb44.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb358411650>
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F79%252Fd879999586841f80767da0b447b84895%252Fpa%252FPC06950_615e6742a4fcfde871990935da0b3a29.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_615e6742a4fcfde871990935da0b3a29.jpg saved to cache
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 648b6b51-4eac-5af1-9292-9a719642bc7d
2026-03-27 20:33:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 648b6b51-4eac-5af1-9292-9a719642bc7d, skipping ID generation
2026-03-27 20:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 648b6b51-4eac-5af1-9292-9a719642bc7d with scrape type 1
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 648b6b51-4eac-5af1-9292-9a719642bc7d sending to next pipeline
2026-03-27 20:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 648b6b51-4eac-5af1-9292-9a719642bc7d, identifier: PC06950
2026-03-27 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_a929567275a4f505faea9a75e639bd69.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:15 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-27 20:33:15 [auto1.be] INFO: Scrape type for HH24769: 1
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_abec6dc71da1f657c9d35f95caea4c1a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_abec6dc71da1f657c9d35f95caea4c1a.jpg not downloaded yet
2026-03-27 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS95861> (referer: https://www.auto1.com/v1/car-details-view/YS95861/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB94076> (referer: https://www.auto1.com/v1/car-details-view/YB94076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA25293> (referer: https://www.auto1.com/v1/car-details-view/EA25293/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950
2026-03-27 20:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950
2026-03-27 20:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950 to the API
2026-03-27 20:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_615e6742a4fcfde871990935da0b3a29.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 55,
 'expiration_date': '2026-03-28T16:25:37Z',
 'fuel_type': 'petrol',
 'id': '648b6b51-4eac-5af1-9292-9a719642bc7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC06950',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Fiat',
 'model': 'Seicento',
 'odometer': 69680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_5cd66124f796812729ff5e642526b8d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_badfe5db0715eeb2d8f6a21c0290443b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_f34b581b2bb884b6fedb4986711fb65a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_5627ab3490be69743deddb91942b6564.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_bb176f20acc39474eb72cdb76f2b3ab6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_d0bd30a4d84a208b90c11ca679b93885.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_fd71a4c9afb646ad1f57eaff18838021.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_0f0c844d94130276a7fbc75ea734baec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_edae8fabc9ba7153a6288a2468f6bbc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648b6b51-4eac-5af1-9292-9a719642bc7d/648b6b51-4eac-5af1-9292-9a719642bc7d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/79/d879999586841f80767da0b447b84895/pa/PC06950_615e6742a4fcfde871990935da0b3a29.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-12-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Seicento 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2002}
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [auto1.be] INFO: Saving data for PC06950: {'created_time': 1774643596.097313, 'last_price_update_time': 1774643596.097324, 'auction_closing_time': 1774715137.0}
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC06950') HTTP/1.1" 204 0
2026-03-27 20:33:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:16 [auto1.be] INFO: Found listing with ID: VS70966
2026-03-27 20:33:16 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-27 20:33:16 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-27 20:33:16 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-27 20:33:16 [auto1.be] INFO: Found listing with ID: LR03762
2026-03-27 20:33:16 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [auto1.be] INFO: Scrape type for RG44645: 1
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_88085993d46951d39d50b0b608de1427.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_88085993d46951d39d50b0b608de1427.jpg not downloaded yet
2026-03-27 20:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB74355/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN35442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX99155> (referer: https://www.auto1.com/v1/car-details-view/CX99155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF30387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a2add0>
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_c8b7a6907748ca772e2610a7dd84cb44.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_c8b7a6907748ca772e2610a7dd84cb44.jpg saved to cache
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 587ea13f-532d-5194-a614-83d6c952f2dc
2026-03-27 20:33:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW74184/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_281464dcf87a601ae75ed656791207c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_281464dcf87a601ae75ed656791207c3.jpg not downloaded yet
2026-03-27 20:33:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35368e650>
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_a929567275a4f505faea9a75e639bd69.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_a929567275a4f505faea9a75e639bd69.jpg saved to cache
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 587ea13f-532d-5194-a614-83d6c952f2dc
2026-03-27 20:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28ee8426-e4ef-572d-a445-7ec436f5c923 with identifier: YS95861
2026-03-27 20:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28ee8426-e4ef-572d-a445-7ec436f5c923 with scrape type 1
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28ee8426-e4ef-572d-a445-7ec436f5c923
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_cecd55ebe36a556121876074d9abe5f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_cecd55ebe36a556121876074d9abe5f0.jpg not downloaded yet
2026-03-27 20:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076
2026-03-27 20:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c30bb17-9073-53c8-a5ed-38c920a8541b with scrape type 1
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c30bb17-9073-53c8-a5ed-38c920a8541b
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_b61c7e8f561066161fd5bbd06e519577.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_b61c7e8f561066161fd5bbd06e519577.jpg not downloaded yet
2026-03-27 20:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293
2026-03-27 20:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with scrape type 1
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_a52b8da64a5c0d491fc345e5e6e86f18.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_a52b8da64a5c0d491fc345e5e6e86f18.jpg not downloaded yet
2026-03-27 20:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_331df7c6619e46148823a62c9f5ca9c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_8512b6849df3e5b97c9dfcf5734a3a8b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_c90f6abd4f1d8fb2f94a0e6e53f517ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_c90f6abd4f1d8fb2f94a0e6e53f517ad.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_a56d9940a08abb2586254ea0d136ad44.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_a56d9940a08abb2586254ea0d136ad44.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_220ca410aaad80662be5413c7ce4b422.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_220ca410aaad80662be5413c7ce4b422.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_fa6a894e60d0b6866a0c089966cd4653.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_fa6a894e60d0b6866a0c089966cd4653.jpg not downloaded yet
2026-03-27 20:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_044c2fb297ce5cc7608d827dbee0ff5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155
2026-03-27 20:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07109768-a8fd-50b0-91e3-aeb2061c4d22 with scrape type 1
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 07109768-a8fd-50b0-91e3-aeb2061c4d22
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_d369d031b180be04bee3acc4ce5725cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_d369d031b180be04bee3acc4ce5725cd.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_b95e152bceb4a5e2af104cc149146f3c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_b95e152bceb4a5e2af104cc149146f3c.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_e46ab178f4f10e98f03d139470e3382e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_e46ab178f4f10e98f03d139470e3382e.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_feb01767e70e7c4defc1556e9e6ea574.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_feb01767e70e7c4defc1556e9e6ea574.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_6f96bac7c0e3bb15c6d58cfe00efc425.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_6f96bac7c0e3bb15c6d58cfe00efc425.jpg not downloaded yet
2026-03-27 20:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_88085993d46951d39d50b0b608de1427.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_db748e6af34f12294c9b635d87678f9f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_db748e6af34f12294c9b635d87678f9f.jpg not downloaded yet
2026-03-27 20:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_325a1358e39f628299e595e5584278d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_092a88107f623840194b9e2b4c45bb01.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_092a88107f623840194b9e2b4c45bb01.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_102d8cc644fe022734c2cf505332a0e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_102d8cc644fe022734c2cf505332a0e3.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_74f4d1a2a5ae58eed4534e912bc98923.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_74f4d1a2a5ae58eed4534e912bc98923.jpg not downloaded yet
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bd9790>
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_331df7c6619e46148823a62c9f5ca9c5.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_331df7c6619e46148823a62c9f5ca9c5.jpg saved to cache
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 587ea13f-532d-5194-a614-83d6c952f2dc
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3535ad510>
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_8512b6849df3e5b97c9dfcf5734a3a8b.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_8512b6849df3e5b97c9dfcf5734a3a8b.jpg saved to cache
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 587ea13f-532d-5194-a614-83d6c952f2dc
2026-03-27 20:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_abec6dc71da1f657c9d35f95caea4c1a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_ece6eb795a0dc84f858d4faa2d047ca3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_ece6eb795a0dc84f858d4faa2d047ca3.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_b046726d7364cee1fad506e2a703d13c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_b046726d7364cee1fad506e2a703d13c.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_dfdee3df3cefbd2f7544b472a5b6a554.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_dfdee3df3cefbd2f7544b472a5b6a554.jpg not downloaded yet
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_e381e049484bddc1cf3a9eda12f6fdc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_e381e049484bddc1cf3a9eda12f6fdc4.jpg not downloaded yet
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a6c090>
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_044c2fb297ce5cc7608d827dbee0ff5a.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_044c2fb297ce5cc7608d827dbee0ff5a.jpg saved to cache
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 587ea13f-532d-5194-a614-83d6c952f2dc
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_c4946a2ee0e0393398b56a316e8f8b69.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_c4946a2ee0e0393398b56a316e8f8b69.jpg not downloaded yet
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534dbdd0>
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_88085993d46951d39d50b0b608de1427.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_88085993d46951d39d50b0b608de1427.jpg saved to cache
2026-03-27 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 587ea13f-532d-5194-a614-83d6c952f2dc
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf7f90>
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F56%252Fa65603bf95261256e714920d35a1039c%252Fpa%252FWW25551_325a1358e39f628299e595e5584278d1.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_325a1358e39f628299e595e5584278d1.jpg saved to cache
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a67a2e3-1999-5e59-8375-d6e6c272134f
2026-03-27 20:33:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a67a2e3-1999-5e59-8375-d6e6c272134f, skipping ID generation
2026-03-27 20:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a67a2e3-1999-5e59-8375-d6e6c272134f with scrape type 1
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a67a2e3-1999-5e59-8375-d6e6c272134f sending to next pipeline
2026-03-27 20:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3a67a2e3-1999-5e59-8375-d6e6c272134f, identifier: WW25551
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_faebc7a0c4f94a9382039c54eba59be6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_faebc7a0c4f94a9382039c54eba59be6.jpg not downloaded yet
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_cdd9bf91a0f973071d8174bd1fd78de4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_cdd9bf91a0f973071d8174bd1fd78de4.jpg not downloaded yet
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_84fe134a8e0d0d2462e4b3b98ab8a7fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_84fe134a8e0d0d2462e4b3b98ab8a7fa.jpg not downloaded yet
2026-03-27 20:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3a67a2e3-1999-5e59-8375-d6e6c272134f with identifier: WW25551
2026-03-27 20:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3a67a2e3-1999-5e59-8375-d6e6c272134f with identifier: WW25551
2026-03-27 20:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3a67a2e3-1999-5e59-8375-d6e6c272134f with identifier: WW25551 to the API
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_325a1358e39f628299e595e5584278d1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:29:17Z',
 'fuel_type': 'petrol',
 'id': '3a67a2e3-1999-5e59-8375-d6e6c272134f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW25551',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 103091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_325a1358e39f628299e595e5584278d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_373819cc0edc488e9cdb5af9b9f50f63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_881511f86e95e4fe496cdc17043ab479.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_c0cb9998565d86ea1bc43acc2f9d9d69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_c4881289d35d11045912af31222395e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_6a508eb5b24e4e1bbb457de491237bc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_11f7d5162044966f23794e443892bb83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_a90c038d43833bd11f442ae12c4f52f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_73bedf6e2275410b16adf39e44b875f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a67a2e3-1999-5e59-8375-d6e6c272134f/3a67a2e3-1999-5e59-8375-d6e6c272134f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/56/a65603bf95261256e714920d35a1039c/pa/WW25551_b880e9cd0ffc6c536c3085c23ec20786.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turbo Quadrifoglio Verde',
 'transmission': 'manual',
 'trim': 'Quadrifoglio Verde',
 'year': 2011}
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW25551%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [auto1.be] INFO: Saving data for WW25551: {'created_time': 1774643597.635341, 'last_price_update_time': 1774643597.635352, 'auction_closing_time': 1774715357.0}
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WW25551') HTTP/1.1" 204 0
2026-03-27 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_feb01767e70e7c4defc1556e9e6ea574.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_ed7808558750fad38291784ef972fac5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_ed7808558750fad38291784ef972fac5.jpg not downloaded yet
2026-03-27 20:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35348c690>
2026-03-27 20:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_abec6dc71da1f657c9d35f95caea4c1a.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_abec6dc71da1f657c9d35f95caea4c1a.jpg saved to cache
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 587ea13f-532d-5194-a614-83d6c952f2dc
2026-03-27 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_db748e6af34f12294c9b635d87678f9f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_d62165c6a27d9b1818f9313f7e20179e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_d62165c6a27d9b1818f9313f7e20179e.jpg not downloaded yet
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_253f461017d75adbb91fc2ef60a7626d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_253f461017d75adbb91fc2ef60a7626d.jpg not downloaded yet
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_34be6e6d74f4228f889cc33d553eb0e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_34be6e6d74f4228f889cc33d553eb0e7.jpg not downloaded yet
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_36f314ea8b4e4816bcf5fd8a82eb15de.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_36f314ea8b4e4816bcf5fd8a82eb15de.jpg not downloaded yet
2026-03-27 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC96921> (referer: https://www.auto1.com/v1/car-details-view/JC96921/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN92471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV05904> (referer: https://www.auto1.com/v1/car-details-view/YV05904/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE12861/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB55851> (referer: https://www.auto1.com/v1/car-details-view/NB55851/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC14202> (referer: https://www.auto1.com/v1/car-details-view/ZC14202/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY03378> (referer: https://www.auto1.com/v1/car-details-view/BY03378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_a940ca8dffa2680b15589dcbcd5cde8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_a940ca8dffa2680b15589dcbcd5cde8d.jpg not downloaded yet
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_d0b6d2b51dcb3dff0ae9605d70fc5a9c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_d0b6d2b51dcb3dff0ae9605d70fc5a9c.jpg not downloaded yet
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_36b5c7fff1f6c35dc8a890e3aad2ba28.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_36b5c7fff1f6c35dc8a890e3aad2ba28.jpg not downloaded yet
2026-03-27 20:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME81448/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35348e850>
2026-03-27 20:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_feb01767e70e7c4defc1556e9e6ea574.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_feb01767e70e7c4defc1556e9e6ea574.jpg saved to cache
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c30bb17-9073-53c8-a5ed-38c920a8541b
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_736725b0ba9eb7e99677d93b59087228.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_736725b0ba9eb7e99677d93b59087228.jpg not downloaded yet
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_01b552b116c33a4ccd6cc0fce02abd4d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_01b552b116c33a4ccd6cc0fce02abd4d.jpg not downloaded yet
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_78076918d9a1c4023f182989e9bc8c6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_78076918d9a1c4023f182989e9bc8c6b.jpg not downloaded yet
2026-03-27 20:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_c4946a2ee0e0393398b56a316e8f8b69.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ac5450>
2026-03-27 20:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_db748e6af34f12294c9b635d87678f9f.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_db748e6af34f12294c9b635d87678f9f.jpg saved to cache
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07109768-a8fd-50b0-91e3-aeb2061c4d22
2026-03-27 20:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_253f461017d75adbb91fc2ef60a7626d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_3b4aa2212724dc25a7e8539792837e58.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_3b4aa2212724dc25a7e8539792837e58.jpg not downloaded yet
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_1f31eb04644fc3486e8d5b64c183f5da.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_1f31eb04644fc3486e8d5b64c183f5da.jpg not downloaded yet
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_f2734abd230798da0cd028828153857a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_f2734abd230798da0cd028828153857a.jpg not downloaded yet
2026-03-27 20:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_ed7808558750fad38291784ef972fac5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921
2026-03-27 20:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2051630-c42a-5d6f-be76-1902a8b67a62 with scrape type 1
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2051630-c42a-5d6f-be76-1902a8b67a62
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_b43353e6e837dd301d3ebed4d7dd69da.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_b43353e6e837dd301d3ebed4d7dd69da.jpg not downloaded yet
2026-03-27 20:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b86e83a4-f82c-5d33-b38a-7c2b70d791f4 with identifier: YV05904
2026-03-27 20:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b86e83a4-f82c-5d33-b38a-7c2b70d791f4 with scrape type 1
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b86e83a4-f82c-5d33-b38a-7c2b70d791f4
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F08%252Fe3083244fcbf6e0b71964472b610b09b%252Fpa%252FYV05904_b712c34c2db7787b8733f605713fa4c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_b712c34c2db7787b8733f605713fa4c7.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F08%252Fe3083244fcbf6e0b71964472b610b09b%252Fpa%252FYV05904_f05edb70c424ce18b40caf3ead3dc874.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_f05edb70c424ce18b40caf3ead3dc874.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F08%252Fe3083244fcbf6e0b71964472b610b09b%252Fpa%252FYV05904_f821f5b5a0bdbfa13313aecda281e4b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_f821f5b5a0bdbfa13313aecda281e4b2.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F08%252Fe3083244fcbf6e0b71964472b610b09b%252Fpa%252FYV05904_f67be1a8607964483d02ae2ab807158f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_f67be1a8607964483d02ae2ab807158f.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F08%252Fe3083244fcbf6e0b71964472b610b09b%252Fpa%252FYV05904_b63649cc60c35d5e7f8b6756a9b7be0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_b63649cc60c35d5e7f8b6756a9b7be0f.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F08%252Fe3083244fcbf6e0b71964472b610b09b%252Fpa%252FYV05904_4bcfc7d297890e4b89c54b3fcaa1666d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_4bcfc7d297890e4b89c54b3fcaa1666d.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F08%252Fe3083244fcbf6e0b71964472b610b09b%252Fpa%252FYV05904_037cd617a42c83f28cfb286a9d06ce54.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_037cd617a42c83f28cfb286a9d06ce54.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F08%252Fe3083244fcbf6e0b71964472b610b09b%252Fpa%252FYV05904_38b2e436b60719150b589d15d89415a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_38b2e436b60719150b589d15d89415a7.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F08%252Fe3083244fcbf6e0b71964472b610b09b%252Fpa%252FYV05904_eef48550f92d10e6434b603121c25c7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_eef48550f92d10e6434b603121c25c7f.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F08%252Fe3083244fcbf6e0b71964472b610b09b%252Fpa%252FYV05904_0e840859f08b0ac70b9ede64feb8cf91.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_0e840859f08b0ac70b9ede64feb8cf91.jpg already downloaded
2026-03-27 20:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b86e83a4-f82c-5d33-b38a-7c2b70d791f4, identifier: YV05904
2026-03-27 20:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6053f447-3f07-527f-9060-0fe1b44883ff with identifier: NB55851
2026-03-27 20:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6053f447-3f07-527f-9060-0fe1b44883ff with scrape type 1
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6053f447-3f07-527f-9060-0fe1b44883ff
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F7d%252Fae7d28b928d10346881f2d5a255bcbfa%252Fpa%252FNB55851_50c34f83dcf18d693708bc271e79f7d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_50c34f83dcf18d693708bc271e79f7d9.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F7d%252Fae7d28b928d10346881f2d5a255bcbfa%252Fpa%252FNB55851_120e402154131b94dde84e4aab2ff812.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_120e402154131b94dde84e4aab2ff812.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F7d%252Fae7d28b928d10346881f2d5a255bcbfa%252Fpa%252FNB55851_45e05f96a572cfd72e3c5f9d6f0f8fad.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_45e05f96a572cfd72e3c5f9d6f0f8fad.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F7d%252Fae7d28b928d10346881f2d5a255bcbfa%252Fpa%252FNB55851_6ea14710d3be24569188192e197e7560.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_6ea14710d3be24569188192e197e7560.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F7d%252Fae7d28b928d10346881f2d5a255bcbfa%252Fpa%252FNB55851_7ab821f448c193dd7d3cb72b9091f02e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_7ab821f448c193dd7d3cb72b9091f02e.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F7d%252Fae7d28b928d10346881f2d5a255bcbfa%252Fpa%252FNB55851_312f6f407363c8bf6e4627ac2904ced6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_312f6f407363c8bf6e4627ac2904ced6.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F7d%252Fae7d28b928d10346881f2d5a255bcbfa%252Fpa%252FNB55851_ba39709f472d2a379a5021f492b97ad7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_ba39709f472d2a379a5021f492b97ad7.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F7d%252Fae7d28b928d10346881f2d5a255bcbfa%252Fpa%252FNB55851_6a9dab366350aff4ee9bd40cd1942a8c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_6a9dab366350aff4ee9bd40cd1942a8c.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F7d%252Fae7d28b928d10346881f2d5a255bcbfa%252Fpa%252FNB55851_10ee92bf786edcebbe7db10952731890.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_10ee92bf786edcebbe7db10952731890.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F7d%252Fae7d28b928d10346881f2d5a255bcbfa%252Fpa%252FNB55851_58a59e1ac9b6018266d9a3fce7cebaf3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_58a59e1ac9b6018266d9a3fce7cebaf3.jpg already downloaded
2026-03-27 20:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6053f447-3f07-527f-9060-0fe1b44883ff, identifier: NB55851
2026-03-27 20:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25b65c29-6100-56a2-ae86-4d10b4e9700b with identifier: ZC14202
2026-03-27 20:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25b65c29-6100-56a2-ae86-4d10b4e9700b with scrape type 1
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25b65c29-6100-56a2-ae86-4d10b4e9700b
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F15%252F701500be5c1b454ef91d85688d7deeb2%252Fpa%252FZC14202_9cc4319e0a76a84d3b8fc25aee7dc9fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_9cc4319e0a76a84d3b8fc25aee7dc9fd.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F15%252F701500be5c1b454ef91d85688d7deeb2%252Fpa%252FZC14202_78cd0b315f913732949cba18d419f997.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_78cd0b315f913732949cba18d419f997.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F15%252F701500be5c1b454ef91d85688d7deeb2%252Fpa%252FZC14202_ead88dd1d0c82be8eb5cb0ec275042c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_ead88dd1d0c82be8eb5cb0ec275042c8.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F15%252F701500be5c1b454ef91d85688d7deeb2%252Fpa%252FZC14202_dea85683f78ffaabed47546587f202b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_dea85683f78ffaabed47546587f202b9.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F15%252F701500be5c1b454ef91d85688d7deeb2%252Fpa%252FZC14202_cb959e69c74330cedd7b37a25ad32011.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_cb959e69c74330cedd7b37a25ad32011.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F15%252F701500be5c1b454ef91d85688d7deeb2%252Fpa%252FZC14202_baa727cdd0ae2772b751535d0680ee45.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_baa727cdd0ae2772b751535d0680ee45.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F15%252F701500be5c1b454ef91d85688d7deeb2%252Fpa%252FZC14202_bccf2488761fcaaf6b620739b191e5b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_bccf2488761fcaaf6b620739b191e5b4.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F15%252F701500be5c1b454ef91d85688d7deeb2%252Fpa%252FZC14202_2cc52461952016af933e33f7507c2edb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_2cc52461952016af933e33f7507c2edb.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F15%252F701500be5c1b454ef91d85688d7deeb2%252Fpa%252FZC14202_2b400b02e6dc2fa092e5bf6ea7ba33e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_2b400b02e6dc2fa092e5bf6ea7ba33e1.jpg already downloaded
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F15%252F701500be5c1b454ef91d85688d7deeb2%252Fpa%252FZC14202_c4304a16a263ddadaa41c00f92c2a824.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_c4304a16a263ddadaa41c00f92c2a824.jpg already downloaded
2026-03-27 20:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 25b65c29-6100-56a2-ae86-4d10b4e9700b, identifier: ZC14202
2026-03-27 20:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb771658-2e3e-53f0-bb30-056d8480b139 with identifier: BY03378
2026-03-27 20:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb771658-2e3e-53f0-bb30-056d8480b139 with scrape type 1
2026-03-27 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb771658-2e3e-53f0-bb30-056d8480b139
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F60%252F8260f8f0c9cbdcb3e538f577d6f576a0%252Fpa%252FBY03378_ec9c58268316628a9e35fc0e49fd2288.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_ec9c58268316628a9e35fc0e49fd2288.jpg already downloaded
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F60%252F8260f8f0c9cbdcb3e538f577d6f576a0%252Fpa%252FBY03378_da7cec3e43d749a72bc3589f087e0211.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_da7cec3e43d749a72bc3589f087e0211.jpg already downloaded
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F60%252F8260f8f0c9cbdcb3e538f577d6f576a0%252Fpa%252FBY03378_abfc8a02bb143f7fb297828ed29fe754.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_abfc8a02bb143f7fb297828ed29fe754.jpg already downloaded
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F60%252F8260f8f0c9cbdcb3e538f577d6f576a0%252Fpa%252FBY03378_be8d0d2f1d5fec551207d7437ae1d202.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_be8d0d2f1d5fec551207d7437ae1d202.jpg already downloaded
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F60%252F8260f8f0c9cbdcb3e538f577d6f576a0%252Fpa%252FBY03378_5a6a32aa507c23447519dc0f88eb1d91.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_5a6a32aa507c23447519dc0f88eb1d91.jpg already downloaded
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F60%252F8260f8f0c9cbdcb3e538f577d6f576a0%252Fpa%252FBY03378_0687a40af2e1602c4d1b1fd9b3f30a24.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_0687a40af2e1602c4d1b1fd9b3f30a24.jpg already downloaded
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F60%252F8260f8f0c9cbdcb3e538f577d6f576a0%252Fpa%252FBY03378_0cff5608c510f4ad84202b02c25a2537.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_0cff5608c510f4ad84202b02c25a2537.jpg already downloaded
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F60%252F8260f8f0c9cbdcb3e538f577d6f576a0%252Fpa%252FBY03378_72241444a91a4a5267f161f856acb069.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_72241444a91a4a5267f161f856acb069.jpg already downloaded
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F60%252F8260f8f0c9cbdcb3e538f577d6f576a0%252Fpa%252FBY03378_0f4948a651a7db2bc008e83713d0f04a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_0f4948a651a7db2bc008e83713d0f04a.jpg already downloaded
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F60%252F8260f8f0c9cbdcb3e538f577d6f576a0%252Fpa%252FBY03378_977578ad664ecc0bc3dfa8d1d9101338.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_977578ad664ecc0bc3dfa8d1d9101338.jpg already downloaded
2026-03-27 20:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb771658-2e3e-53f0-bb30-056d8480b139, identifier: BY03378
2026-03-27 20:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_cdd9bf91a0f973071d8174bd1fd78de4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b86e83a4-f82c-5d33-b38a-7c2b70d791f4 with identifier: YV05904
2026-03-27 20:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b86e83a4-f82c-5d33-b38a-7c2b70d791f4 with identifier: YV05904
2026-03-27 20:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b86e83a4-f82c-5d33-b38a-7c2b70d791f4 with identifier: YV05904 to the API
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YV05904>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:52:50Z',
 'fuel_type': 'petrol',
 'id': 'b86e83a4-f82c-5d33-b38a-7c2b70d791f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV05904',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 123548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_b712c34c2db7787b8733f605713fa4c7.jpg',
                'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_f05edb70c424ce18b40caf3ead3dc874.jpg',
                'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_f821f5b5a0bdbfa13313aecda281e4b2.jpg',
                'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_f67be1a8607964483d02ae2ab807158f.jpg',
                'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_b63649cc60c35d5e7f8b6756a9b7be0f.jpg',
                'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_4bcfc7d297890e4b89c54b3fcaa1666d.jpg',
                'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_037cd617a42c83f28cfb286a9d06ce54.jpg',
                'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_38b2e436b60719150b589d15d89415a7.jpg',
                'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_eef48550f92d10e6434b603121c25c7f.jpg',
                'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_0e840859f08b0ac70b9ede64feb8cf91.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86e83a4-f82c-5d33-b38a-7c2b70d791f4/b86e83a4-f82c-5d33-b38a-7c2b70d791f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_b712c34c2db7787b8733f605713fa4c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86e83a4-f82c-5d33-b38a-7c2b70d791f4/b86e83a4-f82c-5d33-b38a-7c2b70d791f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_f05edb70c424ce18b40caf3ead3dc874.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86e83a4-f82c-5d33-b38a-7c2b70d791f4/b86e83a4-f82c-5d33-b38a-7c2b70d791f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_f821f5b5a0bdbfa13313aecda281e4b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86e83a4-f82c-5d33-b38a-7c2b70d791f4/b86e83a4-f82c-5d33-b38a-7c2b70d791f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_f67be1a8607964483d02ae2ab807158f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86e83a4-f82c-5d33-b38a-7c2b70d791f4/b86e83a4-f82c-5d33-b38a-7c2b70d791f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_b63649cc60c35d5e7f8b6756a9b7be0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86e83a4-f82c-5d33-b38a-7c2b70d791f4/b86e83a4-f82c-5d33-b38a-7c2b70d791f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_4bcfc7d297890e4b89c54b3fcaa1666d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86e83a4-f82c-5d33-b38a-7c2b70d791f4/b86e83a4-f82c-5d33-b38a-7c2b70d791f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_037cd617a42c83f28cfb286a9d06ce54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86e83a4-f82c-5d33-b38a-7c2b70d791f4/b86e83a4-f82c-5d33-b38a-7c2b70d791f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_38b2e436b60719150b589d15d89415a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86e83a4-f82c-5d33-b38a-7c2b70d791f4/b86e83a4-f82c-5d33-b38a-7c2b70d791f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_eef48550f92d10e6434b603121c25c7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b86e83a4-f82c-5d33-b38a-7c2b70d791f4/b86e83a4-f82c-5d33-b38a-7c2b70d791f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/08/e3083244fcbf6e0b71964472b610b09b/pa/YV05904_0e840859f08b0ac70b9ede64feb8cf91.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 30 Jahre',
 'transmission': 'manual',
 'trim': '30 Jahre',
 'year': 2014}
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV05904%27 HTTP/1.1" 200 None
2026-03-27 20:33:19 [auto1.be] INFO: Saving data for YV05904: {'created_time': 1774643599.744419, 'last_price_update_time': 1774643599.744429, 'auction_closing_time': 1774716770.0}
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YV05904') HTTP/1.1" 204 0
2026-03-27 20:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6053f447-3f07-527f-9060-0fe1b44883ff with identifier: NB55851
2026-03-27 20:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6053f447-3f07-527f-9060-0fe1b44883ff with identifier: NB55851
2026-03-27 20:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6053f447-3f07-527f-9060-0fe1b44883ff with identifier: NB55851 to the API
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NB55851>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:54:51Z',
 'fuel_type': 'diesel',
 'id': '6053f447-3f07-527f-9060-0fe1b44883ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB55851',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 203026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_50c34f83dcf18d693708bc271e79f7d9.jpg',
                'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_120e402154131b94dde84e4aab2ff812.jpg',
                'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_45e05f96a572cfd72e3c5f9d6f0f8fad.jpg',
                'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_6ea14710d3be24569188192e197e7560.jpg',
                'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_7ab821f448c193dd7d3cb72b9091f02e.jpg',
                'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_312f6f407363c8bf6e4627ac2904ced6.jpg',
                'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_ba39709f472d2a379a5021f492b97ad7.jpg',
                'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_6a9dab366350aff4ee9bd40cd1942a8c.jpg',
                'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_10ee92bf786edcebbe7db10952731890.jpg',
                'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_58a59e1ac9b6018266d9a3fce7cebaf3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6053f447-3f07-527f-9060-0fe1b44883ff/6053f447-3f07-527f-9060-0fe1b44883ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48160,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_50c34f83dcf18d693708bc271e79f7d9.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6053f447-3f07-527f-9060-0fe1b44883ff/6053f447-3f07-527f-9060-0fe1b44883ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45030,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_120e402154131b94dde84e4aab2ff812.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6053f447-3f07-527f-9060-0fe1b44883ff/6053f447-3f07-527f-9060-0fe1b44883ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47176,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_45e05f96a572cfd72e3c5f9d6f0f8fad.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6053f447-3f07-527f-9060-0fe1b44883ff/6053f447-3f07-527f-9060-0fe1b44883ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36256,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_6ea14710d3be24569188192e197e7560.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6053f447-3f07-527f-9060-0fe1b44883ff/6053f447-3f07-527f-9060-0fe1b44883ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45652,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_7ab821f448c193dd7d3cb72b9091f02e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6053f447-3f07-527f-9060-0fe1b44883ff/6053f447-3f07-527f-9060-0fe1b44883ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51433,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_312f6f407363c8bf6e4627ac2904ced6.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6053f447-3f07-527f-9060-0fe1b44883ff/6053f447-3f07-527f-9060-0fe1b44883ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37355,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_ba39709f472d2a379a5021f492b97ad7.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6053f447-3f07-527f-9060-0fe1b44883ff/6053f447-3f07-527f-9060-0fe1b44883ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50729,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_6a9dab366350aff4ee9bd40cd1942a8c.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6053f447-3f07-527f-9060-0fe1b44883ff/6053f447-3f07-527f-9060-0fe1b44883ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51524,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_10ee92bf786edcebbe7db10952731890.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6053f447-3f07-527f-9060-0fe1b44883ff/6053f447-3f07-527f-9060-0fe1b44883ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/7d/ae7d28b928d10346881f2d5a255bcbfa/pa/NB55851_58a59e1ac9b6018266d9a3fce7cebaf3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2013}
2026-03-27 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB55851%27 HTTP/1.1" 200 None
2026-03-27 20:33:20 [auto1.be] INFO: Saving data for NB55851: {'created_time': 1774643600.029255, 'last_price_update_time': 1774643600.029264, 'auction_closing_time': 1774716891.0}
2026-03-27 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB55851') HTTP/1.1" 204 0
2026-03-27 20:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 25b65c29-6100-56a2-ae86-4d10b4e9700b with identifier: ZC14202
2026-03-27 20:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 25b65c29-6100-56a2-ae86-4d10b4e9700b with identifier: ZC14202
2026-03-27 20:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 25b65c29-6100-56a2-ae86-4d10b4e9700b with identifier: ZC14202 to the API
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZC14202>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:30:14Z',
 'fuel_type': 'petrol',
 'id': '25b65c29-6100-56a2-ae86-4d10b4e9700b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC14202',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 120149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_9cc4319e0a76a84d3b8fc25aee7dc9fd.jpg',
                'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_78cd0b315f913732949cba18d419f997.jpg',
                'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_ead88dd1d0c82be8eb5cb0ec275042c8.jpg',
                'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_dea85683f78ffaabed47546587f202b9.jpg',
                'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_cb959e69c74330cedd7b37a25ad32011.jpg',
                'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_baa727cdd0ae2772b751535d0680ee45.jpg',
                'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_bccf2488761fcaaf6b620739b191e5b4.jpg',
                'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_2cc52461952016af933e33f7507c2edb.jpg',
                'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_2b400b02e6dc2fa092e5bf6ea7ba33e1.jpg',
                'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_c4304a16a263ddadaa41c00f92c2a824.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b65c29-6100-56a2-ae86-4d10b4e9700b/25b65c29-6100-56a2-ae86-4d10b4e9700b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_9cc4319e0a76a84d3b8fc25aee7dc9fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b65c29-6100-56a2-ae86-4d10b4e9700b/25b65c29-6100-56a2-ae86-4d10b4e9700b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_78cd0b315f913732949cba18d419f997.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b65c29-6100-56a2-ae86-4d10b4e9700b/25b65c29-6100-56a2-ae86-4d10b4e9700b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_ead88dd1d0c82be8eb5cb0ec275042c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b65c29-6100-56a2-ae86-4d10b4e9700b/25b65c29-6100-56a2-ae86-4d10b4e9700b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_dea85683f78ffaabed47546587f202b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b65c29-6100-56a2-ae86-4d10b4e9700b/25b65c29-6100-56a2-ae86-4d10b4e9700b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_cb959e69c74330cedd7b37a25ad32011.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b65c29-6100-56a2-ae86-4d10b4e9700b/25b65c29-6100-56a2-ae86-4d10b4e9700b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_baa727cdd0ae2772b751535d0680ee45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b65c29-6100-56a2-ae86-4d10b4e9700b/25b65c29-6100-56a2-ae86-4d10b4e9700b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_bccf2488761fcaaf6b620739b191e5b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b65c29-6100-56a2-ae86-4d10b4e9700b/25b65c29-6100-56a2-ae86-4d10b4e9700b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_2cc52461952016af933e33f7507c2edb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b65c29-6100-56a2-ae86-4d10b4e9700b/25b65c29-6100-56a2-ae86-4d10b4e9700b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_2b400b02e6dc2fa092e5bf6ea7ba33e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b65c29-6100-56a2-ae86-4d10b4e9700b/25b65c29-6100-56a2-ae86-4d10b4e9700b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/15/701500be5c1b454ef91d85688d7deeb2/pa/ZC14202_c4304a16a263ddadaa41c00f92c2a824.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC14202%27 HTTP/1.1" 200 None
2026-03-27 20:33:21 [auto1.be] INFO: Saving data for ZC14202: {'created_time': 1774643601.285315, 'last_price_update_time': 1774643601.285325, 'auction_closing_time': 1774715414.0}
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC14202') HTTP/1.1" 204 0
2026-03-27 20:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb771658-2e3e-53f0-bb30-056d8480b139 with identifier: BY03378
2026-03-27 20:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb771658-2e3e-53f0-bb30-056d8480b139 with identifier: BY03378
2026-03-27 20:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb771658-2e3e-53f0-bb30-056d8480b139 with identifier: BY03378 to the API
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BY03378>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:29:20Z',
 'fuel_type': 'diesel',
 'id': 'cb771658-2e3e-53f0-bb30-056d8480b139',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY03378',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 75914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_ec9c58268316628a9e35fc0e49fd2288.jpg',
                'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_da7cec3e43d749a72bc3589f087e0211.jpg',
                'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_abfc8a02bb143f7fb297828ed29fe754.jpg',
                'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_be8d0d2f1d5fec551207d7437ae1d202.jpg',
                'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_5a6a32aa507c23447519dc0f88eb1d91.jpg',
                'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_0687a40af2e1602c4d1b1fd9b3f30a24.jpg',
                'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_0cff5608c510f4ad84202b02c25a2537.jpg',
                'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_72241444a91a4a5267f161f856acb069.jpg',
                'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_0f4948a651a7db2bc008e83713d0f04a.jpg',
                'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_977578ad664ecc0bc3dfa8d1d9101338.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb771658-2e3e-53f0-bb30-056d8480b139/cb771658-2e3e-53f0-bb30-056d8480b139_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_ec9c58268316628a9e35fc0e49fd2288.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb771658-2e3e-53f0-bb30-056d8480b139/cb771658-2e3e-53f0-bb30-056d8480b139_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_da7cec3e43d749a72bc3589f087e0211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb771658-2e3e-53f0-bb30-056d8480b139/cb771658-2e3e-53f0-bb30-056d8480b139_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_abfc8a02bb143f7fb297828ed29fe754.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb771658-2e3e-53f0-bb30-056d8480b139/cb771658-2e3e-53f0-bb30-056d8480b139_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_be8d0d2f1d5fec551207d7437ae1d202.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb771658-2e3e-53f0-bb30-056d8480b139/cb771658-2e3e-53f0-bb30-056d8480b139_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_5a6a32aa507c23447519dc0f88eb1d91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb771658-2e3e-53f0-bb30-056d8480b139/cb771658-2e3e-53f0-bb30-056d8480b139_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_0687a40af2e1602c4d1b1fd9b3f30a24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb771658-2e3e-53f0-bb30-056d8480b139/cb771658-2e3e-53f0-bb30-056d8480b139_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_0cff5608c510f4ad84202b02c25a2537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb771658-2e3e-53f0-bb30-056d8480b139/cb771658-2e3e-53f0-bb30-056d8480b139_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_72241444a91a4a5267f161f856acb069.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb771658-2e3e-53f0-bb30-056d8480b139/cb771658-2e3e-53f0-bb30-056d8480b139_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_0f4948a651a7db2bc008e83713d0f04a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb771658-2e3e-53f0-bb30-056d8480b139/cb771658-2e3e-53f0-bb30-056d8480b139_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/60/8260f8f0c9cbdcb3e538f577d6f576a0/pa/BY03378_977578ad664ecc0bc3dfa8d1d9101338.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Combo 1.5 CDTI Edition XL erhöhte Nutzlast',
 'transmission': 'manual',
 'trim': 'Edition XL erhöhte Nutzlast',
 'year': 2021}
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY03378%27 HTTP/1.1" 200 None
2026-03-27 20:33:21 [auto1.be] INFO: Saving data for BY03378: {'created_time': 1774643601.565963, 'last_price_update_time': 1774643601.565972, 'auction_closing_time': 1774715360.0}
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY03378') HTTP/1.1" 204 0
2026-03-27 20:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_faebc7a0c4f94a9382039c54eba59be6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_d907baee26732b0039398e7385828598.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_d907baee26732b0039398e7385828598.jpg not downloaded yet
2026-03-27 20:33:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35285e750>
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_c4946a2ee0e0393398b56a316e8f8b69.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_c4946a2ee0e0393398b56a316e8f8b69.jpg saved to cache
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07109768-a8fd-50b0-91e3-aeb2061c4d22
2026-03-27 20:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_d62165c6a27d9b1818f9313f7e20179e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_443056caedb4bc11d499837a2877022f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_443056caedb4bc11d499837a2877022f.jpg not downloaded yet
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3528884d0>
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_253f461017d75adbb91fc2ef60a7626d.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_253f461017d75adbb91fc2ef60a7626d.jpg saved to cache
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c30bb17-9073-53c8-a5ed-38c920a8541b
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35288ab10>
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_ed7808558750fad38291784ef972fac5.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_ed7808558750fad38291784ef972fac5.jpg saved to cache
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07109768-a8fd-50b0-91e3-aeb2061c4d22
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35281f6d0>
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_cdd9bf91a0f973071d8174bd1fd78de4.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_cdd9bf91a0f973071d8174bd1fd78de4.jpg saved to cache
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c30bb17-9073-53c8-a5ed-38c920a8541b
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_492123ed6bf608731c56342ee1f15c92.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_492123ed6bf608731c56342ee1f15c92.jpg not downloaded yet
2026-03-27 20:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_d0b6d2b51dcb3dff0ae9605d70fc5a9c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_e5300ff3fa479060d4a2236710fcddc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_e5300ff3fa479060d4a2236710fcddc3.jpg not downloaded yet
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529905d0>
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_faebc7a0c4f94a9382039c54eba59be6.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_faebc7a0c4f94a9382039c54eba59be6.jpg saved to cache
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28ee8426-e4ef-572d-a445-7ec436f5c923
2026-03-27 20:33:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529f4f10>
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_d62165c6a27d9b1818f9313f7e20179e.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_d62165c6a27d9b1818f9313f7e20179e.jpg saved to cache
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28ee8426-e4ef-572d-a445-7ec436f5c923
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_d5d473add7d0ac0aaec9a783ff473a4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_d5d473add7d0ac0aaec9a783ff473a4c.jpg not downloaded yet
2026-03-27 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_1c8323b3e65dc46677157acb1963d514.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_1c8323b3e65dc46677157acb1963d514.jpg not downloaded yet
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35368e9d0>
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_d0b6d2b51dcb3dff0ae9605d70fc5a9c.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_d0b6d2b51dcb3dff0ae9605d70fc5a9c.jpg saved to cache
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c30bb17-9073-53c8-a5ed-38c920a8541b
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_3fde78e2fd0c24f8a32c41be8950a891.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_3fde78e2fd0c24f8a32c41be8950a891.jpg not downloaded yet
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_f2734abd230798da0cd028828153857a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_9901255e3c87815953029cb7dbdf9eeb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_9901255e3c87815953029cb7dbdf9eeb.jpg not downloaded yet
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_2a8df16ebb9503e4e38763a48ec6f496.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_2a8df16ebb9503e4e38763a48ec6f496.jpg not downloaded yet
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_d907baee26732b0039398e7385828598.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_34be6e6d74f4228f889cc33d553eb0e7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_84fe134a8e0d0d2462e4b3b98ab8a7fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_6f96bac7c0e3bb15c6d58cfe00efc425.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_a52b8da64a5c0d491fc345e5e6e86f18.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35365afd0>
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_f2734abd230798da0cd028828153857a.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_f2734abd230798da0cd028828153857a.jpg saved to cache
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_443056caedb4bc11d499837a2877022f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_e381e049484bddc1cf3a9eda12f6fdc4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_78076918d9a1c4023f182989e9bc8c6b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35289c950>
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_d907baee26732b0039398e7385828598.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_d907baee26732b0039398e7385828598.jpg saved to cache
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2051630-c42a-5d6f-be76-1902a8b67a62
2026-03-27 20:33:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35355b3d0>
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_34be6e6d74f4228f889cc33d553eb0e7.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_34be6e6d74f4228f889cc33d553eb0e7.jpg saved to cache
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae
2026-03-27 20:33:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35841c550>
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_84fe134a8e0d0d2462e4b3b98ab8a7fa.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_84fe134a8e0d0d2462e4b3b98ab8a7fa.jpg saved to cache
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae
2026-03-27 20:33:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35282bd10>
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_6f96bac7c0e3bb15c6d58cfe00efc425.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_6f96bac7c0e3bb15c6d58cfe00efc425.jpg saved to cache
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae
2026-03-27 20:33:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35348f650>
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_a52b8da64a5c0d491fc345e5e6e86f18.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_a52b8da64a5c0d491fc345e5e6e86f18.jpg saved to cache
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD25678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG44645/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH24769/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP39108> (referer: https://www.auto1.com/v1/car-details-view/LP39108/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME81448> (referer: https://www.auto1.com/v1/car-details-view/ME81448/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE12861> (referer: https://www.auto1.com/v1/car-details-view/SE12861/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35841c390>
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_443056caedb4bc11d499837a2877022f.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_443056caedb4bc11d499837a2877022f.jpg saved to cache
2026-03-27 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2051630-c42a-5d6f-be76-1902a8b67a62
2026-03-27 20:33:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352888410>
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_e381e049484bddc1cf3a9eda12f6fdc4.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_e381e049484bddc1cf3a9eda12f6fdc4.jpg saved to cache
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae
2026-03-27 20:33:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35281d810>
2026-03-27 20:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_78076918d9a1c4023f182989e9bc8c6b.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_78076918d9a1c4023f182989e9bc8c6b.jpg saved to cache
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae
2026-03-27 20:33:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108
2026-03-27 20:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1f9a976-deb2-5b26-aff6-54d606e656f5 with scrape type 1
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1f9a976-deb2-5b26-aff6-54d606e656f5
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0a%252Ff30ab8d1dcc23f20ca31e48c4433e5bc%252Fpa%252FLP39108_0dbbeba3044a738e8a1f261b0a0e5834.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_0dbbeba3044a738e8a1f261b0a0e5834.jpg already downloaded
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0a%252Ff30ab8d1dcc23f20ca31e48c4433e5bc%252Fpa%252FLP39108_fe71f759de88cfcaacda541d325e6c32.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_fe71f759de88cfcaacda541d325e6c32.jpg already downloaded
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0a%252Ff30ab8d1dcc23f20ca31e48c4433e5bc%252Fpa%252FLP39108_0df7800fb00d4dd47767d0583ee6f79d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_0df7800fb00d4dd47767d0583ee6f79d.jpg already downloaded
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0a%252Ff30ab8d1dcc23f20ca31e48c4433e5bc%252Fpa%252FLP39108_4c658537132f96d5e5282dacfa30cd8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_4c658537132f96d5e5282dacfa30cd8e.jpg already downloaded
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0a%252Ff30ab8d1dcc23f20ca31e48c4433e5bc%252Fpa%252FLP39108_7641f31123f2746f846df0285b7aedd3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_7641f31123f2746f846df0285b7aedd3.jpg already downloaded
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0a%252Ff30ab8d1dcc23f20ca31e48c4433e5bc%252Fpa%252FLP39108_d78512ec4db9a81cf59e453e367f0cbc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_d78512ec4db9a81cf59e453e367f0cbc.jpg already downloaded
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0a%252Ff30ab8d1dcc23f20ca31e48c4433e5bc%252Fpa%252FLP39108_a0965f61cf5bd4d44baea6cedd73e7e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_a0965f61cf5bd4d44baea6cedd73e7e2.jpg already downloaded
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0a%252Ff30ab8d1dcc23f20ca31e48c4433e5bc%252Fpa%252FLP39108_2ba244806c3ef8a7bd1c7024d1dcd3f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_2ba244806c3ef8a7bd1c7024d1dcd3f6.jpg already downloaded
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0a%252Ff30ab8d1dcc23f20ca31e48c4433e5bc%252Fpa%252FLP39108_47388ac78acf33ba74cc2faa6a1c2b0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_47388ac78acf33ba74cc2faa6a1c2b0d.jpg already downloaded
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0a%252Ff30ab8d1dcc23f20ca31e48c4433e5bc%252Fpa%252FLP39108_550dcb29201fe5a876aab1c5b76857e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_550dcb29201fe5a876aab1c5b76857e6.jpg already downloaded
2026-03-27 20:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f1f9a976-deb2-5b26-aff6-54d606e656f5, identifier: LP39108
2026-03-27 20:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448
2026-03-27 20:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 951023aa-d4e4-588c-a776-24f8f81552a2 with scrape type 1
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 951023aa-d4e4-588c-a776-24f8f81552a2
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Ff3%252Fe1f3b6fa383a01a9ab1d5693f24da358%252Fpa%252FME81448_246b014a3313871b84ae0fef4d33c6b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_246b014a3313871b84ae0fef4d33c6b5.jpg already downloaded
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Ff3%252Fe1f3b6fa383a01a9ab1d5693f24da358%252Fpa%252FME81448_cb9a138ceab27864d5399ff31e250a7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_cb9a138ceab27864d5399ff31e250a7d.jpg already downloaded
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Ff3%252Fe1f3b6fa383a01a9ab1d5693f24da358%252Fpa%252FME81448_4e6477759646926af2aec6b2edee69c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_4e6477759646926af2aec6b2edee69c8.jpg already downloaded
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Ff3%252Fe1f3b6fa383a01a9ab1d5693f24da358%252Fpa%252FME81448_6b1b3ab8d3f84ed7e0cf952e97f43ca0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_6b1b3ab8d3f84ed7e0cf952e97f43ca0.jpg already downloaded
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Ff3%252Fe1f3b6fa383a01a9ab1d5693f24da358%252Fpa%252FME81448_504d984fd0c968862efabcc5461d7ed0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_504d984fd0c968862efabcc5461d7ed0.jpg already downloaded
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Ff3%252Fe1f3b6fa383a01a9ab1d5693f24da358%252Fpa%252FME81448_c170f5d8acac9ae7768dda52841961dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_c170f5d8acac9ae7768dda52841961dc.jpg already downloaded
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Ff3%252Fe1f3b6fa383a01a9ab1d5693f24da358%252Fpa%252FME81448_1b396c104904e2a86a749b695ede68e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_1b396c104904e2a86a749b695ede68e6.jpg already downloaded
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Ff3%252Fe1f3b6fa383a01a9ab1d5693f24da358%252Fpa%252FME81448_810aad66e446c12b5192c9fc5a4a76cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_810aad66e446c12b5192c9fc5a4a76cf.jpg already downloaded
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Ff3%252Fe1f3b6fa383a01a9ab1d5693f24da358%252Fpa%252FME81448_8f075b248cb6cc35394acb3f2a91abc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_8f075b248cb6cc35394acb3f2a91abc2.jpg already downloaded
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Ff3%252Fe1f3b6fa383a01a9ab1d5693f24da358%252Fpa%252FME81448_2c66078e8f3e82f20c356d98824b2fdd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_2c66078e8f3e82f20c356d98824b2fdd.jpg already downloaded
2026-03-27 20:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 951023aa-d4e4-588c-a776-24f8f81552a2, identifier: ME81448
2026-03-27 20:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861
2026-03-27 20:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3958b6f2-330e-537a-b8a3-483a87ed7f71 with scrape type 1
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3958b6f2-330e-537a-b8a3-483a87ed7f71
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_9c9dae40a79c6525a630f1fbcd2363fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_9c9dae40a79c6525a630f1fbcd2363fc.jpg not downloaded yet
2026-03-27 20:33:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108
2026-03-27 20:33:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108
2026-03-27 20:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108 to the API
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LP39108>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:10:02Z',
 'fuel_type': 'petrol',
 'id': 'f1f9a976-deb2-5b26-aff6-54d606e656f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP39108',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 191515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_0dbbeba3044a738e8a1f261b0a0e5834.jpg',
                'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_fe71f759de88cfcaacda541d325e6c32.jpg',
                'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_0df7800fb00d4dd47767d0583ee6f79d.jpg',
                'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_4c658537132f96d5e5282dacfa30cd8e.jpg',
                'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_7641f31123f2746f846df0285b7aedd3.jpg',
                'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_d78512ec4db9a81cf59e453e367f0cbc.jpg',
                'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_a0965f61cf5bd4d44baea6cedd73e7e2.jpg',
                'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_2ba244806c3ef8a7bd1c7024d1dcd3f6.jpg',
                'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_47388ac78acf33ba74cc2faa6a1c2b0d.jpg',
                'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_550dcb29201fe5a876aab1c5b76857e6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f9a976-deb2-5b26-aff6-54d606e656f5/f1f9a976-deb2-5b26-aff6-54d606e656f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537850,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_0dbbeba3044a738e8a1f261b0a0e5834.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f9a976-deb2-5b26-aff6-54d606e656f5/f1f9a976-deb2-5b26-aff6-54d606e656f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2616290,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_fe71f759de88cfcaacda541d325e6c32.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f9a976-deb2-5b26-aff6-54d606e656f5/f1f9a976-deb2-5b26-aff6-54d606e656f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2628150,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_0df7800fb00d4dd47767d0583ee6f79d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f9a976-deb2-5b26-aff6-54d606e656f5/f1f9a976-deb2-5b26-aff6-54d606e656f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2575295,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_4c658537132f96d5e5282dacfa30cd8e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f9a976-deb2-5b26-aff6-54d606e656f5/f1f9a976-deb2-5b26-aff6-54d606e656f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2555292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_7641f31123f2746f846df0285b7aedd3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f9a976-deb2-5b26-aff6-54d606e656f5/f1f9a976-deb2-5b26-aff6-54d606e656f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2611643,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_d78512ec4db9a81cf59e453e367f0cbc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f9a976-deb2-5b26-aff6-54d606e656f5/f1f9a976-deb2-5b26-aff6-54d606e656f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_a0965f61cf5bd4d44baea6cedd73e7e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f9a976-deb2-5b26-aff6-54d606e656f5/f1f9a976-deb2-5b26-aff6-54d606e656f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2700952,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_2ba244806c3ef8a7bd1c7024d1dcd3f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f9a976-deb2-5b26-aff6-54d606e656f5/f1f9a976-deb2-5b26-aff6-54d606e656f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2636849,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_47388ac78acf33ba74cc2faa6a1c2b0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f9a976-deb2-5b26-aff6-54d606e656f5/f1f9a976-deb2-5b26-aff6-54d606e656f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573081,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0a/f30ab8d1dcc23f20ca31e48c4433e5bc/pa/LP39108_550dcb29201fe5a876aab1c5b76857e6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.4 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-27 20:33:24 [auto1.be] INFO: Saving data for LP39108: {'created_time': 1774643604.714687, 'last_price_update_time': 1774643604.714699, 'auction_closing_time': 1774714202.0}
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP39108') HTTP/1.1" 204 0
2026-03-27 20:33:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448
2026-03-27 20:33:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448
2026-03-27 20:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448 to the API
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ME81448>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:11:55Z',
 'fuel_type': 'petrol',
 'id': '951023aa-d4e4-588c-a776-24f8f81552a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME81448',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 49900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_246b014a3313871b84ae0fef4d33c6b5.jpg',
                'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_cb9a138ceab27864d5399ff31e250a7d.jpg',
                'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_4e6477759646926af2aec6b2edee69c8.jpg',
                'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_6b1b3ab8d3f84ed7e0cf952e97f43ca0.jpg',
                'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_504d984fd0c968862efabcc5461d7ed0.jpg',
                'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_c170f5d8acac9ae7768dda52841961dc.jpg',
                'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_1b396c104904e2a86a749b695ede68e6.jpg',
                'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_810aad66e446c12b5192c9fc5a4a76cf.jpg',
                'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_8f075b248cb6cc35394acb3f2a91abc2.jpg',
                'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_2c66078e8f3e82f20c356d98824b2fdd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951023aa-d4e4-588c-a776-24f8f81552a2/951023aa-d4e4-588c-a776-24f8f81552a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_246b014a3313871b84ae0fef4d33c6b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951023aa-d4e4-588c-a776-24f8f81552a2/951023aa-d4e4-588c-a776-24f8f81552a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3007772,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_cb9a138ceab27864d5399ff31e250a7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951023aa-d4e4-588c-a776-24f8f81552a2/951023aa-d4e4-588c-a776-24f8f81552a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2506454,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_4e6477759646926af2aec6b2edee69c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951023aa-d4e4-588c-a776-24f8f81552a2/951023aa-d4e4-588c-a776-24f8f81552a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2433393,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_6b1b3ab8d3f84ed7e0cf952e97f43ca0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951023aa-d4e4-588c-a776-24f8f81552a2/951023aa-d4e4-588c-a776-24f8f81552a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2890140,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_504d984fd0c968862efabcc5461d7ed0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951023aa-d4e4-588c-a776-24f8f81552a2/951023aa-d4e4-588c-a776-24f8f81552a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762423,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_c170f5d8acac9ae7768dda52841961dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951023aa-d4e4-588c-a776-24f8f81552a2/951023aa-d4e4-588c-a776-24f8f81552a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2142705,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_1b396c104904e2a86a749b695ede68e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951023aa-d4e4-588c-a776-24f8f81552a2/951023aa-d4e4-588c-a776-24f8f81552a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2986929,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_810aad66e446c12b5192c9fc5a4a76cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951023aa-d4e4-588c-a776-24f8f81552a2/951023aa-d4e4-588c-a776-24f8f81552a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2824549,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_8f075b248cb6cc35394acb3f2a91abc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951023aa-d4e4-588c-a776-24f8f81552a2/951023aa-d4e4-588c-a776-24f8f81552a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1960806,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/f3/e1f3b6fa383a01a9ab1d5693f24da358/pa/ME81448_2c66078e8f3e82f20c356d98824b2fdd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-27 20:33:25 [auto1.be] INFO: Saving data for ME81448: {'created_time': 1774643605.028998, 'last_price_update_time': 1774643605.029011, 'auction_closing_time': 1774714315.0}
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ME81448') HTTP/1.1" 204 0
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_c858213afe572aad7e9f408f6b01befd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_c858213afe572aad7e9f408f6b01befd.jpg not downloaded yet
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_d5d473add7d0ac0aaec9a783ff473a4c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_ab2db45c290cc46e4d9f645096a2912a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_ab2db45c290cc46e4d9f645096a2912a.jpg not downloaded yet
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_684c58ffebb951be70df81cc5ac67022.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_684c58ffebb951be70df81cc5ac67022.jpg not downloaded yet
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_36b5c7fff1f6c35dc8a890e3aad2ba28.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_b43353e6e837dd301d3ebed4d7dd69da.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_45035d3926277aa4c12b63c6966e40f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_45035d3926277aa4c12b63c6966e40f3.jpg not downloaded yet
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_d103c2933734b59669379aec11ff1af3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_d103c2933734b59669379aec11ff1af3.jpg not downloaded yet
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_83f47fb747c2c2841c626d09dd67cd75.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_83f47fb747c2c2841c626d09dd67cd75.jpg not downloaded yet
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35953ee90>
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_d5d473add7d0ac0aaec9a783ff473a4c.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_d5d473add7d0ac0aaec9a783ff473a4c.jpg saved to cache
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2051630-c42a-5d6f-be76-1902a8b67a62
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_ad3041ad25d9e2d9ac7f11a4818bfc15.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_ad3041ad25d9e2d9ac7f11a4818bfc15.jpg not downloaded yet
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_1f31eb04644fc3486e8d5b64c183f5da.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_34355aee6e8851fa45d8a68feaf21548.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_34355aee6e8851fa45d8a68feaf21548.jpg not downloaded yet
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_3b4aa2212724dc25a7e8539792837e58.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_8b6e224e4f8790c19851ab2a77814fef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_8b6e224e4f8790c19851ab2a77814fef.jpg not downloaded yet
2026-03-27 20:33:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b3b350>
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_36b5c7fff1f6c35dc8a890e3aad2ba28.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_36b5c7fff1f6c35dc8a890e3aad2ba28.jpg saved to cache
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35343bb90>
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_b43353e6e837dd301d3ebed4d7dd69da.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_b43353e6e837dd301d3ebed4d7dd69da.jpg saved to cache
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2051630-c42a-5d6f-be76-1902a8b67a62
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_01b552b116c33a4ccd6cc0fce02abd4d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529e2ed0>
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_1f31eb04644fc3486e8d5b64c183f5da.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_1f31eb04644fc3486e8d5b64c183f5da.jpg saved to cache
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c30bb17-9073-53c8-a5ed-38c920a8541b
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf5d10>
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_3b4aa2212724dc25a7e8539792837e58.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_3b4aa2212724dc25a7e8539792837e58.jpg saved to cache
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28ee8426-e4ef-572d-a445-7ec436f5c923
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_1c8323b3e65dc46677157acb1963d514.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_2a8df16ebb9503e4e38763a48ec6f496.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_9901255e3c87815953029cb7dbdf9eeb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_3fde78e2fd0c24f8a32c41be8950a891.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_492123ed6bf608731c56342ee1f15c92.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_e5300ff3fa479060d4a2236710fcddc3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b08150>
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_01b552b116c33a4ccd6cc0fce02abd4d.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_01b552b116c33a4ccd6cc0fce02abd4d.jpg saved to cache
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c30bb17-9073-53c8-a5ed-38c920a8541b
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_36f314ea8b4e4816bcf5fd8a82eb15de.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb365cdffd0>
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_1c8323b3e65dc46677157acb1963d514.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_1c8323b3e65dc46677157acb1963d514.jpg saved to cache
2026-03-27 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2051630-c42a-5d6f-be76-1902a8b67a62
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_736725b0ba9eb7e99677d93b59087228.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_a940ca8dffa2680b15589dcbcd5cde8d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a06310>
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_2a8df16ebb9503e4e38763a48ec6f496.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_2a8df16ebb9503e4e38763a48ec6f496.jpg saved to cache
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2051630-c42a-5d6f-be76-1902a8b67a62
2026-03-27 20:33:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534a8510>
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_9901255e3c87815953029cb7dbdf9eeb.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_9901255e3c87815953029cb7dbdf9eeb.jpg saved to cache
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2051630-c42a-5d6f-be76-1902a8b67a62
2026-03-27 20:33:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35342a310>
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_3fde78e2fd0c24f8a32c41be8950a891.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_3fde78e2fd0c24f8a32c41be8950a891.jpg saved to cache
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2051630-c42a-5d6f-be76-1902a8b67a62
2026-03-27 20:33:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b0b710>
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_492123ed6bf608731c56342ee1f15c92.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_492123ed6bf608731c56342ee1f15c92.jpg saved to cache
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2051630-c42a-5d6f-be76-1902a8b67a62
2026-03-27 20:33:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3598e52d0>
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F0c%252F360c900ec651c3fc4e104f5d3c557f90%252Fpa%252FJC96921_e5300ff3fa479060d4a2236710fcddc3.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_e5300ff3fa479060d4a2236710fcddc3.jpg saved to cache
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2051630-c42a-5d6f-be76-1902a8b67a62
2026-03-27 20:33:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2051630-c42a-5d6f-be76-1902a8b67a62, skipping ID generation
2026-03-27 20:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2051630-c42a-5d6f-be76-1902a8b67a62 with scrape type 1
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2051630-c42a-5d6f-be76-1902a8b67a62 sending to next pipeline
2026-03-27 20:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2051630-c42a-5d6f-be76-1902a8b67a62, identifier: JC96921
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35968a0d0>
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_36f314ea8b4e4816bcf5fd8a82eb15de.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_36f314ea8b4e4816bcf5fd8a82eb15de.jpg saved to cache
2026-03-27 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07109768-a8fd-50b0-91e3-aeb2061c4d22
2026-03-27 20:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921
2026-03-27 20:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921
2026-03-27 20:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921 to the API
2026-03-27 20:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_e5300ff3fa479060d4a2236710fcddc3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:35:24Z',
 'fuel_type': 'diesel',
 'id': 'd2051630-c42a-5d6f-be76-1902a8b67a62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC96921',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 95234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_b43353e6e837dd301d3ebed4d7dd69da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_d907baee26732b0039398e7385828598.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_443056caedb4bc11d499837a2877022f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2470443,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_492123ed6bf608731c56342ee1f15c92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2493876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_e5300ff3fa479060d4a2236710fcddc3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_d5d473add7d0ac0aaec9a783ff473a4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2432909,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_1c8323b3e65dc46677157acb1963d514.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2594698,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_3fde78e2fd0c24f8a32c41be8950a891.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2534351,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_9901255e3c87815953029cb7dbdf9eeb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2051630-c42a-5d6f-be76-1902a8b67a62/d2051630-c42a-5d6f-be76-1902a8b67a62_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2553629,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/0c/360c900ec651c3fc4e104f5d3c557f90/pa/JC96921_2a8df16ebb9503e4e38763a48ec6f496.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-27 20:33:27 [auto1.be] INFO: Saving data for JC96921: {'created_time': 1774643607.231004, 'last_price_update_time': 1774643607.231017, 'auction_closing_time': 1774715724.0}
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC96921') HTTP/1.1" 204 0
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536911d0>
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_736725b0ba9eb7e99677d93b59087228.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_736725b0ba9eb7e99677d93b59087228.jpg saved to cache
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28ee8426-e4ef-572d-a445-7ec436f5c923
2026-03-27 20:33:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529da090>
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_a940ca8dffa2680b15589dcbcd5cde8d.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_a940ca8dffa2680b15589dcbcd5cde8d.jpg saved to cache
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28ee8426-e4ef-572d-a445-7ec436f5c923
2026-03-27 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN92471> (referer: https://www.auto1.com/v1/car-details-view/XN92471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_9c9dae40a79c6525a630f1fbcd2363fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_34355aee6e8851fa45d8a68feaf21548.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_684c58ffebb951be70df81cc5ac67022.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_ab2db45c290cc46e4d9f645096a2912a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_83f47fb747c2c2841c626d09dd67cd75.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_8b6e224e4f8790c19851ab2a77814fef.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471
2026-03-27 20:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84ac1513-66b8-5a90-a85c-273bcb8746f0 with scrape type 1
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84ac1513-66b8-5a90-a85c-273bcb8746f0
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_ca03c2318c55d9202603cdbeb52b7c90.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_ca03c2318c55d9202603cdbeb52b7c90.jpg not downloaded yet
2026-03-27 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_74f4d1a2a5ae58eed4534e912bc98923.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_ece6eb795a0dc84f858d4faa2d047ca3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_add08100040660baadac06c76ab9e269.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_add08100040660baadac06c76ab9e269.jpg not downloaded yet
2026-03-27 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_dfdee3df3cefbd2f7544b472a5b6a554.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_980738935832b57f7b91568d89bf1837.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_980738935832b57f7b91568d89bf1837.jpg not downloaded yet
2026-03-27 20:33:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35354a710>
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_9c9dae40a79c6525a630f1fbcd2363fc.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_9c9dae40a79c6525a630f1fbcd2363fc.jpg saved to cache
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3958b6f2-330e-537a-b8a3-483a87ed7f71
2026-03-27 20:33:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352956b90>
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_34355aee6e8851fa45d8a68feaf21548.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_34355aee6e8851fa45d8a68feaf21548.jpg saved to cache
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3958b6f2-330e-537a-b8a3-483a87ed7f71
2026-03-27 20:33:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3598e12d0>
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_684c58ffebb951be70df81cc5ac67022.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_684c58ffebb951be70df81cc5ac67022.jpg saved to cache
2026-03-27 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3958b6f2-330e-537a-b8a3-483a87ed7f71
2026-03-27 20:33:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352954a50>
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_ab2db45c290cc46e4d9f645096a2912a.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_ab2db45c290cc46e4d9f645096a2912a.jpg saved to cache
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3958b6f2-330e-537a-b8a3-483a87ed7f71
2026-03-27 20:33:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352922250>
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_83f47fb747c2c2841c626d09dd67cd75.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_83f47fb747c2c2841c626d09dd67cd75.jpg saved to cache
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3958b6f2-330e-537a-b8a3-483a87ed7f71
2026-03-27 20:33:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352954690>
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_8b6e224e4f8790c19851ab2a77814fef.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_8b6e224e4f8790c19851ab2a77814fef.jpg saved to cache
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3958b6f2-330e-537a-b8a3-483a87ed7f71
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_ad3041ad25d9e2d9ac7f11a4818bfc15.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_b49e85a44f1457c9faf04b775a1ba590.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_b49e85a44f1457c9faf04b775a1ba590.jpg not downloaded yet
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_b046726d7364cee1fad506e2a703d13c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_c4e11fa6411a20936faa5504f3a0e28a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_c4e11fa6411a20936faa5504f3a0e28a.jpg not downloaded yet
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35284fe10>
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_74f4d1a2a5ae58eed4534e912bc98923.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_74f4d1a2a5ae58eed4534e912bc98923.jpg saved to cache
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534a80d0>
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_ece6eb795a0dc84f858d4faa2d047ca3.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_ece6eb795a0dc84f858d4faa2d047ca3.jpg saved to cache
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07109768-a8fd-50b0-91e3-aeb2061c4d22
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb359d760d0>
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_dfdee3df3cefbd2f7544b472a5b6a554.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_dfdee3df3cefbd2f7544b472a5b6a554.jpg saved to cache
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c30bb17-9073-53c8-a5ed-38c920a8541b
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_975eba5fdd3a07afe38198ec984817aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_975eba5fdd3a07afe38198ec984817aa.jpg not downloaded yet
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_365a1ae8045de5de9ec43f89ebff8bbf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_365a1ae8045de5de9ec43f89ebff8bbf.jpg not downloaded yet
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529acb10>
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_ad3041ad25d9e2d9ac7f11a4818bfc15.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_ad3041ad25d9e2d9ac7f11a4818bfc15.jpg saved to cache
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3958b6f2-330e-537a-b8a3-483a87ed7f71
2026-03-27 20:33:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352981310>
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_b046726d7364cee1fad506e2a703d13c.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_b046726d7364cee1fad506e2a703d13c.jpg saved to cache
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28ee8426-e4ef-572d-a445-7ec436f5c923
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_cf980f6604779088ac6a73296c571a2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_cf980f6604779088ac6a73296c571a2d.jpg not downloaded yet
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_102d8cc644fe022734c2cf505332a0e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_2f09301f2440d0de0a87e8b6b09fc23d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_2f09301f2440d0de0a87e8b6b09fc23d.jpg not downloaded yet
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_d7b26d4eb083251bda8f02a68658bc6c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_d7b26d4eb083251bda8f02a68658bc6c.jpg not downloaded yet
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_092a88107f623840194b9e2b4c45bb01.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_d103c2933734b59669379aec11ff1af3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_45035d3926277aa4c12b63c6966e40f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_c858213afe572aad7e9f408f6b01befd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_980738935832b57f7b91568d89bf1837.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_ca03c2318c55d9202603cdbeb52b7c90.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_b95e152bceb4a5e2af104cc149146f3c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3535a2190>
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_102d8cc644fe022734c2cf505332a0e3.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_102d8cc644fe022734c2cf505332a0e3.jpg saved to cache
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c30bb17-9073-53c8-a5ed-38c920a8541b
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_d369d031b180be04bee3acc4ce5725cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529ac350>
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_092a88107f623840194b9e2b4c45bb01.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_092a88107f623840194b9e2b4c45bb01.jpg saved to cache
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28ee8426-e4ef-572d-a445-7ec436f5c923
2026-03-27 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_e46ab178f4f10e98f03d139470e3382e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35368fc10>
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_d103c2933734b59669379aec11ff1af3.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_d103c2933734b59669379aec11ff1af3.jpg saved to cache
2026-03-27 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3958b6f2-330e-537a-b8a3-483a87ed7f71
2026-03-27 20:33:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b65250>
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_45035d3926277aa4c12b63c6966e40f3.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_45035d3926277aa4c12b63c6966e40f3.jpg saved to cache
2026-03-27 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3958b6f2-330e-537a-b8a3-483a87ed7f71
2026-03-27 20:33:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529363d0>
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F7b%252F917b02afd9552991514901f64272b53b%252Fpa%252FSE12861_c858213afe572aad7e9f408f6b01befd.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_c858213afe572aad7e9f408f6b01befd.jpg saved to cache
2026-03-27 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3958b6f2-330e-537a-b8a3-483a87ed7f71
2026-03-27 20:33:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3958b6f2-330e-537a-b8a3-483a87ed7f71, skipping ID generation
2026-03-27 20:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3958b6f2-330e-537a-b8a3-483a87ed7f71 with scrape type 1
2026-03-27 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3958b6f2-330e-537a-b8a3-483a87ed7f71 sending to next pipeline
2026-03-27 20:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3958b6f2-330e-537a-b8a3-483a87ed7f71, identifier: SE12861
2026-03-27 20:33:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353690610>
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_980738935832b57f7b91568d89bf1837.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_980738935832b57f7b91568d89bf1837.jpg saved to cache
2026-03-27 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84ac1513-66b8-5a90-a85c-273bcb8746f0
2026-03-27 20:33:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536ac810>
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_ca03c2318c55d9202603cdbeb52b7c90.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_ca03c2318c55d9202603cdbeb52b7c90.jpg saved to cache
2026-03-27 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84ac1513-66b8-5a90-a85c-273bcb8746f0
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b691d0>
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_b95e152bceb4a5e2af104cc149146f3c.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_b95e152bceb4a5e2af104cc149146f3c.jpg saved to cache
2026-03-27 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 587ea13f-532d-5194-a614-83d6c952f2dc
2026-03-27 20:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861
2026-03-27 20:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861
2026-03-27 20:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861 to the API
2026-03-27 20:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_c858213afe572aad7e9f408f6b01befd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:46:26Z',
 'fuel_type': 'diesel',
 'id': '3958b6f2-330e-537a-b8a3-483a87ed7f71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE12861',
 'listing': 'auction',
 'location': 'BE, Messancy',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 206586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2620247,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_9c9dae40a79c6525a630f1fbcd2363fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655187,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_c858213afe572aad7e9f408f6b01befd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2621702,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_ab2db45c290cc46e4d9f645096a2912a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613103,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_684c58ffebb951be70df81cc5ac67022.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612318,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_45035d3926277aa4c12b63c6966e40f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_d103c2933734b59669379aec11ff1af3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793380,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_83f47fb747c2c2841c626d09dd67cd75.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_ad3041ad25d9e2d9ac7f11a4818bfc15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2605255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_34355aee6e8851fa45d8a68feaf21548.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3958b6f2-330e-537a-b8a3-483a87ed7f71/3958b6f2-330e-537a-b8a3-483a87ed7f71_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3044962,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/7b/917b02afd9552991514901f64272b53b/pa/SE12861_8b6e224e4f8790c19851ab2a77814fef.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-27 20:33:30 [auto1.be] INFO: Saving data for SE12861: {'created_time': 1774643610.224222, 'last_price_update_time': 1774643610.224232, 'auction_closing_time': 1774716386.0}
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SE12861') HTTP/1.1" 204 0
2026-03-27 20:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_add08100040660baadac06c76ab9e269.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH24769> (referer: https://www.auto1.com/v1/car-details-view/HH24769/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD25678> (referer: https://www.auto1.com/v1/car-details-view/UD25678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG44645> (referer: https://www.auto1.com/v1/car-details-view/RG44645/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF30387> (referer: https://www.auto1.com/v1/car-details-view/YF30387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352aeabd0>
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa1%252Fe9a17d30ad0098e83d93c0d76910f15d%252Fpa%252FCX99155_d369d031b180be04bee3acc4ce5725cd.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_d369d031b180be04bee3acc4ce5725cd.jpg saved to cache
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07109768-a8fd-50b0-91e3-aeb2061c4d22
2026-03-27 20:33:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07109768-a8fd-50b0-91e3-aeb2061c4d22, skipping ID generation
2026-03-27 20:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07109768-a8fd-50b0-91e3-aeb2061c4d22 with scrape type 1
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07109768-a8fd-50b0-91e3-aeb2061c4d22 sending to next pipeline
2026-03-27 20:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07109768-a8fd-50b0-91e3-aeb2061c4d22, identifier: CX99155
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353470110>
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_e46ab178f4f10e98f03d139470e3382e.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_e46ab178f4f10e98f03d139470e3382e.jpg saved to cache
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28ee8426-e4ef-572d-a445-7ec436f5c923
2026-03-27 20:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155
2026-03-27 20:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155
2026-03-27 20:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155 to the API
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_d369d031b180be04bee3acc4ce5725cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:58:33Z',
 'fuel_type': 'diesel',
 'id': '07109768-a8fd-50b0-91e3-aeb2061c4d22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX99155',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 230408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_d369d031b180be04bee3acc4ce5725cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_db748e6af34f12294c9b635d87678f9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_ece6eb795a0dc84f858d4faa2d047ca3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_c4946a2ee0e0393398b56a316e8f8b69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_ed7808558750fad38291784ef972fac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07109768-a8fd-50b0-91e3-aeb2061c4d22/07109768-a8fd-50b0-91e3-aeb2061c4d22_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a1/e9a17d30ad0098e83d93c0d76910f15d/pa/CX99155_36f314ea8b4e4816bcf5fd8a82eb15de.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2013}
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-27 20:33:30 [auto1.be] INFO: Saving data for CX99155: {'created_time': 1774643610.708655, 'last_price_update_time': 1774643610.708666, 'auction_closing_time': 1774717113.0}
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CX99155') HTTP/1.1" 204 0
2026-03-27 20:33:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35296df50>
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_add08100040660baadac06c76ab9e269.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_add08100040660baadac06c76ab9e269.jpg saved to cache
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84ac1513-66b8-5a90-a85c-273bcb8746f0
2026-03-27 20:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769
2026-03-27 20:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with scrape type 1
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_cbb60691cb5a0152ed9dc28b619a4f15.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_cbb60691cb5a0152ed9dc28b619a4f15.jpg not downloaded yet
2026-03-27 20:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5ba6dc9-777f-50d9-b52a-e53f65750e9b with identifier: UD25678
2026-03-27 20:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5ba6dc9-777f-50d9-b52a-e53f65750e9b with scrape type 1
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a5ba6dc9-777f-50d9-b52a-e53f65750e9b
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_a78b9eac126e8b4e775cb8871fc9083c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_a78b9eac126e8b4e775cb8871fc9083c.jpg not downloaded yet
2026-03-27 20:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645
2026-03-27 20:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a01386-52ec-53c5-9081-20e192543e2a with scrape type 1
2026-03-27 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7a01386-52ec-53c5-9081-20e192543e2a
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F93%252Fb893d3b0b3093d5c4728d9923186c6cf%252Fpa%252FRG44645_6837e84e97b7f3503e30070a56894369.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_6837e84e97b7f3503e30070a56894369.jpg already downloaded
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F93%252Fb893d3b0b3093d5c4728d9923186c6cf%252Fpa%252FRG44645_3463ff83f1a81561d3d13d03545f4334.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_3463ff83f1a81561d3d13d03545f4334.jpg already downloaded
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F93%252Fb893d3b0b3093d5c4728d9923186c6cf%252Fpa%252FRG44645_b2ff2bc14074b8dbdb53fb78bf8b0f91.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_b2ff2bc14074b8dbdb53fb78bf8b0f91.jpg already downloaded
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F93%252Fb893d3b0b3093d5c4728d9923186c6cf%252Fpa%252FRG44645_f35a0faf8dbf4260d14e356ab953e569.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_f35a0faf8dbf4260d14e356ab953e569.jpg already downloaded
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F93%252Fb893d3b0b3093d5c4728d9923186c6cf%252Fpa%252FRG44645_f6afafaf28674911895f86107e513dbf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_f6afafaf28674911895f86107e513dbf.jpg already downloaded
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F93%252Fb893d3b0b3093d5c4728d9923186c6cf%252Fpa%252FRG44645_286e624f3dbbafcbfdbc75cfd445de4e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_286e624f3dbbafcbfdbc75cfd445de4e.jpg already downloaded
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F93%252Fb893d3b0b3093d5c4728d9923186c6cf%252Fpa%252FRG44645_823437e82e307ed4aab95e0ba57df371.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_823437e82e307ed4aab95e0ba57df371.jpg already downloaded
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F93%252Fb893d3b0b3093d5c4728d9923186c6cf%252Fpa%252FRG44645_212b20b62009636b2a4c96503e52a6a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_212b20b62009636b2a4c96503e52a6a9.jpg already downloaded
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F93%252Fb893d3b0b3093d5c4728d9923186c6cf%252Fpa%252FRG44645_07bec7ce6cf607baeb1084c5a2ffb15f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_07bec7ce6cf607baeb1084c5a2ffb15f.jpg already downloaded
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F93%252Fb893d3b0b3093d5c4728d9923186c6cf%252Fpa%252FRG44645_3b817feb75d6741a2433c835eb53c18c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_3b817feb75d6741a2433c835eb53c18c.jpg already downloaded
2026-03-27 20:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7a01386-52ec-53c5-9081-20e192543e2a, identifier: RG44645
2026-03-27 20:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387
2026-03-27 20:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc with scrape type 1
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_b2486fca784bc07c3e7a0db71e67e3e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_b2486fca784bc07c3e7a0db71e67e3e0.jpg not downloaded yet
2026-03-27 20:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645
2026-03-27 20:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645
2026-03-27 20:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645 to the API
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RG44645>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:47Z',
 'fuel_type': 'diesel',
 'id': 'b7a01386-52ec-53c5-9081-20e192543e2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG44645',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '2er',
 'odometer': 231514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_6837e84e97b7f3503e30070a56894369.jpg',
                'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_3463ff83f1a81561d3d13d03545f4334.jpg',
                'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_b2ff2bc14074b8dbdb53fb78bf8b0f91.jpg',
                'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_f35a0faf8dbf4260d14e356ab953e569.jpg',
                'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_f6afafaf28674911895f86107e513dbf.jpg',
                'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_286e624f3dbbafcbfdbc75cfd445de4e.jpg',
                'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_823437e82e307ed4aab95e0ba57df371.jpg',
                'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_212b20b62009636b2a4c96503e52a6a9.jpg',
                'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_07bec7ce6cf607baeb1084c5a2ffb15f.jpg',
                'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_3b817feb75d6741a2433c835eb53c18c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a01386-52ec-53c5-9081-20e192543e2a/b7a01386-52ec-53c5-9081-20e192543e2a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_6837e84e97b7f3503e30070a56894369.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a01386-52ec-53c5-9081-20e192543e2a/b7a01386-52ec-53c5-9081-20e192543e2a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_3463ff83f1a81561d3d13d03545f4334.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a01386-52ec-53c5-9081-20e192543e2a/b7a01386-52ec-53c5-9081-20e192543e2a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_b2ff2bc14074b8dbdb53fb78bf8b0f91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a01386-52ec-53c5-9081-20e192543e2a/b7a01386-52ec-53c5-9081-20e192543e2a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_f35a0faf8dbf4260d14e356ab953e569.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a01386-52ec-53c5-9081-20e192543e2a/b7a01386-52ec-53c5-9081-20e192543e2a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_f6afafaf28674911895f86107e513dbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a01386-52ec-53c5-9081-20e192543e2a/b7a01386-52ec-53c5-9081-20e192543e2a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_286e624f3dbbafcbfdbc75cfd445de4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a01386-52ec-53c5-9081-20e192543e2a/b7a01386-52ec-53c5-9081-20e192543e2a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_823437e82e307ed4aab95e0ba57df371.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a01386-52ec-53c5-9081-20e192543e2a/b7a01386-52ec-53c5-9081-20e192543e2a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_212b20b62009636b2a4c96503e52a6a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a01386-52ec-53c5-9081-20e192543e2a/b7a01386-52ec-53c5-9081-20e192543e2a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_07bec7ce6cf607baeb1084c5a2ffb15f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a01386-52ec-53c5-9081-20e192543e2a/b7a01386-52ec-53c5-9081-20e192543e2a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/93/b893d3b0b3093d5c4728d9923186c6cf/pa/RG44645_3b817feb75d6741a2433c835eb53c18c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218d Active Tourer Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2015}
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [auto1.be] INFO: Saving data for RG44645: {'created_time': 1774643611.764016, 'last_price_update_time': 1774643611.764029, 'auction_closing_time': 1774715867.0}
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RG44645') HTTP/1.1" 204 0
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_4ecee00cd5d138b64301d22c34593a7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_4ecee00cd5d138b64301d22c34593a7e.jpg not downloaded yet
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_b075f5d67ab0bb5419818309dab39679.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_b075f5d67ab0bb5419818309dab39679.jpg not downloaded yet
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_181db3e15197ada02f951c44207b5820.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_181db3e15197ada02f951c44207b5820.jpg not downloaded yet
2026-03-27 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_b49e85a44f1457c9faf04b775a1ba590.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_4bef09a984d27a7b0161808a2e78c2dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_4bef09a984d27a7b0161808a2e78c2dc.jpg not downloaded yet
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_9e909e598c3da8a22b60f47e89348812.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_9e909e598c3da8a22b60f47e89348812.jpg not downloaded yet
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_7a19c9b5fd20c2271cbc6729fe6d9cfb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_7a19c9b5fd20c2271cbc6729fe6d9cfb.jpg not downloaded yet
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_6046a031234e41e582ecc69710923776.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_6046a031234e41e582ecc69710923776.jpg not downloaded yet
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_5c36a667fa8342e28f73dd90c2cf6be5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_5c36a667fa8342e28f73dd90c2cf6be5.jpg not downloaded yet
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_0089a6e1442c8728fd9ae0fa36f48af7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_0089a6e1442c8728fd9ae0fa36f48af7.jpg not downloaded yet
2026-03-27 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_220ca410aaad80662be5413c7ce4b422.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_23687565906fa1e1e59458db5ccca592.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_23687565906fa1e1e59458db5ccca592.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_d5b3e32f4c5abe2709d003379bf47ade.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_d5b3e32f4c5abe2709d003379bf47ade.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_d1c75580caaa3a66fac7a985d42d44ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_d1c75580caaa3a66fac7a985d42d44ec.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_ab79c161c6f4e5f7f631371bb7bdb957.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_ab79c161c6f4e5f7f631371bb7bdb957.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_7c164605b40bb21de63c47b2b664871c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_7c164605b40bb21de63c47b2b664871c.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_0966bf57a52a05fa485313bb4a3d2893.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_0966bf57a52a05fa485313bb4a3d2893.jpg not downloaded yet
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534d9350>
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_b49e85a44f1457c9faf04b775a1ba590.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_b49e85a44f1457c9faf04b775a1ba590.jpg saved to cache
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84ac1513-66b8-5a90-a85c-273bcb8746f0
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_bf1c30b18b944e711a2cda8c96c28a6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_bf1c30b18b944e711a2cda8c96c28a6e.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_3c81367b5d83c47ef36a52cae2a4e944.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_3c81367b5d83c47ef36a52cae2a4e944.jpg not downloaded yet
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3595056d0>
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_220ca410aaad80662be5413c7ce4b422.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_220ca410aaad80662be5413c7ce4b422.jpg saved to cache
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c30bb17-9073-53c8-a5ed-38c920a8541b
2026-03-27 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_a56d9940a08abb2586254ea0d136ad44.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_e95f3dac7ab8f08da922c3616cc1d4ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_e95f3dac7ab8f08da922c3616cc1d4ce.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_6e8fbe8f3e1b40f346d3b7595bd624e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_6e8fbe8f3e1b40f346d3b7595bd624e3.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_64215d7bb16e7444567298687d2bd84c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_64215d7bb16e7444567298687d2bd84c.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_679738775c9783117664ff46397a60b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_679738775c9783117664ff46397a60b8.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_74b86acfeb00c03e7ac84c1b8f788c71.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_74b86acfeb00c03e7ac84c1b8f788c71.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_4ad4f04bc3fd854dc4d337ded4e7fde2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_4ad4f04bc3fd854dc4d337ded4e7fde2.jpg not downloaded yet
2026-03-27 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN35442> (referer: https://www.auto1.com/v1/car-details-view/WN35442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352be5d10>
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_a56d9940a08abb2586254ea0d136ad44.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_a56d9940a08abb2586254ea0d136ad44.jpg saved to cache
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28ee8426-e4ef-572d-a445-7ec436f5c923
2026-03-27 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_c90f6abd4f1d8fb2f94a0e6e53f517ad.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08f7d18c-3461-51cd-abc3-3d0acde4af63 with identifier: WN35442
2026-03-27 20:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08f7d18c-3461-51cd-abc3-3d0acde4af63 with scrape type 1
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 08f7d18c-3461-51cd-abc3-3d0acde4af63
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3f%252Fd83fa720d653d42f5c7921e99d96d2f6%252Fpa%252FWN35442_a78c610dc8155e364b6b11756a76058b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_a78c610dc8155e364b6b11756a76058b.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3f%252Fd83fa720d653d42f5c7921e99d96d2f6%252Fpa%252FWN35442_fe4f7a61c3f5a0a5ccebf1a177e5effb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_fe4f7a61c3f5a0a5ccebf1a177e5effb.jpg not downloaded yet
2026-03-27 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_365a1ae8045de5de9ec43f89ebff8bbf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB74355> (referer: https://www.auto1.com/v1/car-details-view/LB74355/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3f%252Fd83fa720d653d42f5c7921e99d96d2f6%252Fpa%252FWN35442_d7ce69750e03b454644fa2ef2efb8d29.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_d7ce69750e03b454644fa2ef2efb8d29.jpg not downloaded yet
2026-03-27 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_d7b26d4eb083251bda8f02a68658bc6c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_b61c7e8f561066161fd5bbd06e519577.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3f%252Fd83fa720d653d42f5c7921e99d96d2f6%252Fpa%252FWN35442_5b69184305cbdb4525046d5f7f4c79cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_5b69184305cbdb4525046d5f7f4c79cf.jpg not downloaded yet
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3f%252Fd83fa720d653d42f5c7921e99d96d2f6%252Fpa%252FWN35442_66573519c978fc5778b8d238873263c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_66573519c978fc5778b8d238873263c9.jpg not downloaded yet
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35342a250>
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_c90f6abd4f1d8fb2f94a0e6e53f517ad.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_c90f6abd4f1d8fb2f94a0e6e53f517ad.jpg saved to cache
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 587ea13f-532d-5194-a614-83d6c952f2dc
2026-03-27 20:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_0089a6e1442c8728fd9ae0fa36f48af7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a70c10>
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_365a1ae8045de5de9ec43f89ebff8bbf.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_365a1ae8045de5de9ec43f89ebff8bbf.jpg saved to cache
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84ac1513-66b8-5a90-a85c-273bcb8746f0
2026-03-27 20:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1 with identifier: LB74355
2026-03-27 20:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1 with scrape type 1
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F91%252Fe991618927b78aa9ea2849578630d4b8%252Fpa%252FLB74355_1f8258e12fb981ab75140c7c7132f608.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_1f8258e12fb981ab75140c7c7132f608.jpg already downloaded
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F91%252Fe991618927b78aa9ea2849578630d4b8%252Fpa%252FLB74355_23c1527efe366007549d7b6c959acb55.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_23c1527efe366007549d7b6c959acb55.jpg already downloaded
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F91%252Fe991618927b78aa9ea2849578630d4b8%252Fpa%252FLB74355_e6b778158d42cc17fe50d21b4bab3181.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_e6b778158d42cc17fe50d21b4bab3181.jpg already downloaded
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F91%252Fe991618927b78aa9ea2849578630d4b8%252Fpa%252FLB74355_bae3586f3d5a3f861de5b41c8ff0c2c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_bae3586f3d5a3f861de5b41c8ff0c2c4.jpg already downloaded
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F91%252Fe991618927b78aa9ea2849578630d4b8%252Fpa%252FLB74355_dd56b4ca435fea32d645ac25208a37d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_dd56b4ca435fea32d645ac25208a37d0.jpg already downloaded
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F91%252Fe991618927b78aa9ea2849578630d4b8%252Fpa%252FLB74355_84d7e16224abe21573ebddbe503522a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_84d7e16224abe21573ebddbe503522a0.jpg already downloaded
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F91%252Fe991618927b78aa9ea2849578630d4b8%252Fpa%252FLB74355_3447537492fb416c44186e7c31bbb582.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_3447537492fb416c44186e7c31bbb582.jpg already downloaded
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F91%252Fe991618927b78aa9ea2849578630d4b8%252Fpa%252FLB74355_ef2fe66069a02093a8cee6b6bd19ea1f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_ef2fe66069a02093a8cee6b6bd19ea1f.jpg already downloaded
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F91%252Fe991618927b78aa9ea2849578630d4b8%252Fpa%252FLB74355_aa7a18c56baf828e521ff27a5aa770db.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_aa7a18c56baf828e521ff27a5aa770db.jpg already downloaded
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F91%252Fe991618927b78aa9ea2849578630d4b8%252Fpa%252FLB74355_41bbdf97618cf849c0864e49d441f9ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_41bbdf97618cf849c0864e49d441f9ce.jpg already downloaded
2026-03-27 20:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1, identifier: LB74355
2026-03-27 20:33:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35354b810>
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_d7b26d4eb083251bda8f02a68658bc6c.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_d7b26d4eb083251bda8f02a68658bc6c.jpg saved to cache
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84ac1513-66b8-5a90-a85c-273bcb8746f0
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529ed490>
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc1%252F7ac1bd26e7a0d139904216ccd34f3700%252Fpa%252FYB94076_b61c7e8f561066161fd5bbd06e519577.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_b61c7e8f561066161fd5bbd06e519577.jpg saved to cache
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c30bb17-9073-53c8-a5ed-38c920a8541b
2026-03-27 20:33:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c30bb17-9073-53c8-a5ed-38c920a8541b, skipping ID generation
2026-03-27 20:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c30bb17-9073-53c8-a5ed-38c920a8541b with scrape type 1
2026-03-27 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c30bb17-9073-53c8-a5ed-38c920a8541b sending to next pipeline
2026-03-27 20:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c30bb17-9073-53c8-a5ed-38c920a8541b, identifier: YB94076
2026-03-27 20:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_cecd55ebe36a556121876074d9abe5f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1 with identifier: LB74355
2026-03-27 20:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1 with identifier: LB74355
2026-03-27 20:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1 with identifier: LB74355 to the API
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LB74355>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:05:45Z',
 'fuel_type': 'diesel',
 'id': 'ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB74355',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 240390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_1f8258e12fb981ab75140c7c7132f608.jpg',
                'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_23c1527efe366007549d7b6c959acb55.jpg',
                'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_e6b778158d42cc17fe50d21b4bab3181.jpg',
                'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_bae3586f3d5a3f861de5b41c8ff0c2c4.jpg',
                'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_dd56b4ca435fea32d645ac25208a37d0.jpg',
                'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_84d7e16224abe21573ebddbe503522a0.jpg',
                'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_3447537492fb416c44186e7c31bbb582.jpg',
                'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_ef2fe66069a02093a8cee6b6bd19ea1f.jpg',
                'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_aa7a18c56baf828e521ff27a5aa770db.jpg',
                'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_41bbdf97618cf849c0864e49d441f9ce.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1/ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_1f8258e12fb981ab75140c7c7132f608.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1/ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_23c1527efe366007549d7b6c959acb55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1/ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_e6b778158d42cc17fe50d21b4bab3181.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1/ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_bae3586f3d5a3f861de5b41c8ff0c2c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1/ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_dd56b4ca435fea32d645ac25208a37d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1/ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_84d7e16224abe21573ebddbe503522a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1/ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_3447537492fb416c44186e7c31bbb582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1/ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_ef2fe66069a02093a8cee6b6bd19ea1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1/ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_aa7a18c56baf828e521ff27a5aa770db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1/ea12c775-02c3-5f1d-b7a9-38c7b0a1b8c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/91/e991618927b78aa9ea2849578630d4b8/pa/LB74355_41bbdf97618cf849c0864e49d441f9ce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB74355%27 HTTP/1.1" 200 None
2026-03-27 20:33:34 [auto1.be] INFO: Saving data for LB74355: {'created_time': 1774643614.336592, 'last_price_update_time': 1774643614.336603, 'auction_closing_time': 1774713945.0}
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LB74355') HTTP/1.1" 204 0
2026-03-27 20:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076
2026-03-27 20:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076
2026-03-27 20:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076 to the API
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_b61c7e8f561066161fd5bbd06e519577.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:13:57Z',
 'fuel_type': 'diesel',
 'id': '9c30bb17-9073-53c8-a5ed-38c920a8541b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB94076',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'BMW',
 'model': '3er',
 'odometer': 232221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_b61c7e8f561066161fd5bbd06e519577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_220ca410aaad80662be5413c7ce4b422.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_feb01767e70e7c4defc1556e9e6ea574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_102d8cc644fe022734c2cf505332a0e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_dfdee3df3cefbd2f7544b472a5b6a554.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_cdd9bf91a0f973071d8174bd1fd78de4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_253f461017d75adbb91fc2ef60a7626d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_d0b6d2b51dcb3dff0ae9605d70fc5a9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_01b552b116c33a4ccd6cc0fce02abd4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c30bb17-9073-53c8-a5ed-38c920a8541b/9c30bb17-9073-53c8-a5ed-38c920a8541b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/c1/7ac1bd26e7a0d139904216ccd34f3700/pa/YB94076_1f31eb04644fc3486e8d5b64c183f5da.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-27 20:33:34 [auto1.be] INFO: Saving data for YB94076: {'created_time': 1774643614.667974, 'last_price_update_time': 1774643614.667986, 'auction_closing_time': 1774714437.0}
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YB94076') HTTP/1.1" 204 0
2026-03-27 20:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_3c81367b5d83c47ef36a52cae2a4e944.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35288c350>
2026-03-27 20:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_0089a6e1442c8728fd9ae0fa36f48af7.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_0089a6e1442c8728fd9ae0fa36f48af7.jpg saved to cache
2026-03-27 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc
2026-03-27 20:33:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3594e12d0>
2026-03-27 20:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F908219f9517189ef374d948696e55027%252Fpa%252FYS95861_cecd55ebe36a556121876074d9abe5f0.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_cecd55ebe36a556121876074d9abe5f0.jpg saved to cache
2026-03-27 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28ee8426-e4ef-572d-a445-7ec436f5c923
2026-03-27 20:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28ee8426-e4ef-572d-a445-7ec436f5c923, skipping ID generation
2026-03-27 20:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28ee8426-e4ef-572d-a445-7ec436f5c923 with scrape type 1
2026-03-27 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28ee8426-e4ef-572d-a445-7ec436f5c923 sending to next pipeline
2026-03-27 20:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 28ee8426-e4ef-572d-a445-7ec436f5c923, identifier: YS95861
2026-03-27 20:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 28ee8426-e4ef-572d-a445-7ec436f5c923 with identifier: YS95861
2026-03-27 20:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 28ee8426-e4ef-572d-a445-7ec436f5c923 with identifier: YS95861
2026-03-27 20:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 28ee8426-e4ef-572d-a445-7ec436f5c923 with identifier: YS95861 to the API
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_cecd55ebe36a556121876074d9abe5f0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:09Z',
 'fuel_type': 'petrol',
 'id': '28ee8426-e4ef-572d-a445-7ec436f5c923',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS95861',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 159460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 423473,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_cecd55ebe36a556121876074d9abe5f0.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_a56d9940a08abb2586254ea0d136ad44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_e46ab178f4f10e98f03d139470e3382e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461920,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_092a88107f623840194b9e2b4c45bb01.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384601,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_b046726d7364cee1fad506e2a703d13c.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_faebc7a0c4f94a9382039c54eba59be6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451483,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_d62165c6a27d9b1818f9313f7e20179e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440768,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_a940ca8dffa2680b15589dcbcd5cde8d.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_736725b0ba9eb7e99677d93b59087228.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ee8426-e4ef-572d-a445-7ec436f5c923/28ee8426-e4ef-572d-a445-7ec436f5c923_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/908219f9517189ef374d948696e55027/pa/YS95861_3b4aa2212724dc25a7e8539792837e58.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2016}
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS95861%27 HTTP/1.1" 200 None
2026-03-27 20:33:35 [auto1.be] INFO: Saving data for YS95861: {'created_time': 1774643615.380539, 'last_price_update_time': 1774643615.38055, 'auction_closing_time': 1774714749.0}
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS95861') HTTP/1.1" 204 0
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_74b86acfeb00c03e7ac84c1b8f788c71.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_4ad4f04bc3fd854dc4d337ded4e7fde2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ad99d0>
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_3c81367b5d83c47ef36a52cae2a4e944.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_3c81367b5d83c47ef36a52cae2a4e944.jpg saved to cache
2026-03-27 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_c4e11fa6411a20936faa5504f3a0e28a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_2f09301f2440d0de0a87e8b6b09fc23d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_975eba5fdd3a07afe38198ec984817aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_cf980f6604779088ac6a73296c571a2d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_fa6a894e60d0b6866a0c089966cd4653.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf4190>
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_74b86acfeb00c03e7ac84c1b8f788c71.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_74b86acfeb00c03e7ac84c1b8f788c71.jpg saved to cache
2026-03-27 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_5b69184305cbdb4525046d5f7f4c79cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a06a90>
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_4ad4f04bc3fd854dc4d337ded4e7fde2.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_4ad4f04bc3fd854dc4d337ded4e7fde2.jpg saved to cache
2026-03-27 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_a78c610dc8155e364b6b11756a76058b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_66573519c978fc5778b8d238873263c9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_d7ce69750e03b454644fa2ef2efb8d29.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_fe4f7a61c3f5a0a5ccebf1a177e5effb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529f5550>
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_c4e11fa6411a20936faa5504f3a0e28a.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_c4e11fa6411a20936faa5504f3a0e28a.jpg saved to cache
2026-03-27 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84ac1513-66b8-5a90-a85c-273bcb8746f0
2026-03-27 20:33:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf5c50>
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_2f09301f2440d0de0a87e8b6b09fc23d.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_2f09301f2440d0de0a87e8b6b09fc23d.jpg saved to cache
2026-03-27 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84ac1513-66b8-5a90-a85c-273bcb8746f0
2026-03-27 20:33:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352adaf10>
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_975eba5fdd3a07afe38198ec984817aa.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_975eba5fdd3a07afe38198ec984817aa.jpg saved to cache
2026-03-27 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84ac1513-66b8-5a90-a85c-273bcb8746f0
2026-03-27 20:33:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352982d50>
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5b%252Fd35bcfda46192f8494d49d0fb8ef575c%252Fpa%252FXN92471_cf980f6604779088ac6a73296c571a2d.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_cf980f6604779088ac6a73296c571a2d.jpg saved to cache
2026-03-27 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84ac1513-66b8-5a90-a85c-273bcb8746f0
2026-03-27 20:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84ac1513-66b8-5a90-a85c-273bcb8746f0, skipping ID generation
2026-03-27 20:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84ac1513-66b8-5a90-a85c-273bcb8746f0 with scrape type 1
2026-03-27 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84ac1513-66b8-5a90-a85c-273bcb8746f0 sending to next pipeline
2026-03-27 20:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 84ac1513-66b8-5a90-a85c-273bcb8746f0, identifier: XN92471
2026-03-27 20:33:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35343b5d0>
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fbc%252F07bc49e3a618777530e7e30381e474a7%252Fpa%252FEA25293_fa6a894e60d0b6866a0c089966cd4653.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_fa6a894e60d0b6866a0c089966cd4653.jpg saved to cache
2026-03-27 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae
2026-03-27 20:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae, skipping ID generation
2026-03-27 20:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with scrape type 1
2026-03-27 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae sending to next pipeline
2026-03-27 20:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae, identifier: EA25293
2026-03-27 20:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471
2026-03-27 20:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471
2026-03-27 20:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471 to the API
2026-03-27 20:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_cf980f6604779088ac6a73296c571a2d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:56:14Z',
 'fuel_type': 'petrol',
 'id': '84ac1513-66b8-5a90-a85c-273bcb8746f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN92471',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 77780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3563641,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_ca03c2318c55d9202603cdbeb52b7c90.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3442611,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_add08100040660baadac06c76ab9e269.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3576018,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_980738935832b57f7b91568d89bf1837.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_b49e85a44f1457c9faf04b775a1ba590.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3214950,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_c4e11fa6411a20936faa5504f3a0e28a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3438533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_975eba5fdd3a07afe38198ec984817aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2837880,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_365a1ae8045de5de9ec43f89ebff8bbf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3416072,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_cf980f6604779088ac6a73296c571a2d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3406105,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_2f09301f2440d0de0a87e8b6b09fc23d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ac1513-66b8-5a90-a85c-273bcb8746f0/84ac1513-66b8-5a90-a85c-273bcb8746f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3093862,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5b/d35bcfda46192f8494d49d0fb8ef575c/pa/XN92471_d7b26d4eb083251bda8f02a68658bc6c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-27 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-27 20:33:37 [auto1.be] INFO: Saving data for XN92471: {'created_time': 1774643617.196526, 'last_price_update_time': 1774643617.196538, 'auction_closing_time': 1774716974.0}
2026-03-27 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XN92471') HTTP/1.1" 204 0
2026-03-27 20:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293
2026-03-27 20:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293
2026-03-27 20:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293 to the API
2026-03-27 20:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_fa6a894e60d0b6866a0c089966cd4653.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:59:46Z',
 'fuel_type': 'petrol',
 'id': '48cb7c2b-fc61-55e8-8315-8bc240ab5aae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA25293',
 'listing': 'auction',
 'location': 'BE, Herk-de-Stad',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 123744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3676722,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_a52b8da64a5c0d491fc345e5e6e86f18.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3492632,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_fa6a894e60d0b6866a0c089966cd4653.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3077070,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_6f96bac7c0e3bb15c6d58cfe00efc425.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_74f4d1a2a5ae58eed4534e912bc98923.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3393365,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_e381e049484bddc1cf3a9eda12f6fdc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539684,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_84fe134a8e0d0d2462e4b3b98ab8a7fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2123943,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_34be6e6d74f4228f889cc33d553eb0e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608944,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_36b5c7fff1f6c35dc8a890e3aad2ba28.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3561499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_78076918d9a1c4023f182989e9bc8c6b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48cb7c2b-fc61-55e8-8315-8bc240ab5aae/48cb7c2b-fc61-55e8-8315-8bc240ab5aae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/bc/07bc49e3a618777530e7e30381e474a7/pa/EA25293_f2734abd230798da0cd028828153857a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-27 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-27 20:33:38 [auto1.be] INFO: Saving data for EA25293: {'created_time': 1774643618.56467, 'last_price_update_time': 1774643618.564682, 'auction_closing_time': 1774717186.0}
2026-03-27 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EA25293') HTTP/1.1" 204 0
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529a8410>
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f7d18c-3461-51cd-abc3-3d0acde4af63/08f7d18c-3461-51cd-abc3-3d0acde4af63_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3f%252Fd83fa720d653d42f5c7921e99d96d2f6%252Fpa%252FWN35442_5b69184305cbdb4525046d5f7f4c79cf.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_5b69184305cbdb4525046d5f7f4c79cf.jpg saved to cache
2026-03-27 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08f7d18c-3461-51cd-abc3-3d0acde4af63
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3528653d0>
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f7d18c-3461-51cd-abc3-3d0acde4af63/08f7d18c-3461-51cd-abc3-3d0acde4af63_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3f%252Fd83fa720d653d42f5c7921e99d96d2f6%252Fpa%252FWN35442_a78c610dc8155e364b6b11756a76058b.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_a78c610dc8155e364b6b11756a76058b.jpg saved to cache
2026-03-27 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08f7d18c-3461-51cd-abc3-3d0acde4af63
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35298bc50>
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f7d18c-3461-51cd-abc3-3d0acde4af63/08f7d18c-3461-51cd-abc3-3d0acde4af63_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3f%252Fd83fa720d653d42f5c7921e99d96d2f6%252Fpa%252FWN35442_66573519c978fc5778b8d238873263c9.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_66573519c978fc5778b8d238873263c9.jpg saved to cache
2026-03-27 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08f7d18c-3461-51cd-abc3-3d0acde4af63
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352abaed0>
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f7d18c-3461-51cd-abc3-3d0acde4af63/08f7d18c-3461-51cd-abc3-3d0acde4af63_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3f%252Fd83fa720d653d42f5c7921e99d96d2f6%252Fpa%252FWN35442_d7ce69750e03b454644fa2ef2efb8d29.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_d7ce69750e03b454644fa2ef2efb8d29.jpg saved to cache
2026-03-27 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08f7d18c-3461-51cd-abc3-3d0acde4af63
2026-03-27 20:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35289f850>
2026-03-27 20:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f7d18c-3461-51cd-abc3-3d0acde4af63/08f7d18c-3461-51cd-abc3-3d0acde4af63_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3f%252Fd83fa720d653d42f5c7921e99d96d2f6%252Fpa%252FWN35442_fe4f7a61c3f5a0a5ccebf1a177e5effb.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_fe4f7a61c3f5a0a5ccebf1a177e5effb.jpg saved to cache
2026-03-27 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08f7d18c-3461-51cd-abc3-3d0acde4af63
2026-03-27 20:33:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08f7d18c-3461-51cd-abc3-3d0acde4af63, skipping ID generation
2026-03-27 20:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08f7d18c-3461-51cd-abc3-3d0acde4af63 with scrape type 1
2026-03-27 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08f7d18c-3461-51cd-abc3-3d0acde4af63 sending to next pipeline
2026-03-27 20:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 08f7d18c-3461-51cd-abc3-3d0acde4af63, identifier: WN35442
2026-03-27 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_e95f3dac7ab8f08da922c3616cc1d4ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 08f7d18c-3461-51cd-abc3-3d0acde4af63 with identifier: WN35442
2026-03-27 20:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 08f7d18c-3461-51cd-abc3-3d0acde4af63 with identifier: WN35442
2026-03-27 20:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 08f7d18c-3461-51cd-abc3-3d0acde4af63 with identifier: WN35442 to the API
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_fe4f7a61c3f5a0a5ccebf1a177e5effb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:13:10Z',
 'fuel_type': 'diesel',
 'id': '08f7d18c-3461-51cd-abc3-3d0acde4af63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN35442',
 'listing': 'auction',
 'location': 'BE, Strépy Bracquegnies (La Louviere)',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 216287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f7d18c-3461-51cd-abc3-3d0acde4af63/08f7d18c-3461-51cd-abc3-3d0acde4af63_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_a78c610dc8155e364b6b11756a76058b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f7d18c-3461-51cd-abc3-3d0acde4af63/08f7d18c-3461-51cd-abc3-3d0acde4af63_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_fe4f7a61c3f5a0a5ccebf1a177e5effb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f7d18c-3461-51cd-abc3-3d0acde4af63/08f7d18c-3461-51cd-abc3-3d0acde4af63_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_d7ce69750e03b454644fa2ef2efb8d29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f7d18c-3461-51cd-abc3-3d0acde4af63/08f7d18c-3461-51cd-abc3-3d0acde4af63_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_5b69184305cbdb4525046d5f7f4c79cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f7d18c-3461-51cd-abc3-3d0acde4af63/08f7d18c-3461-51cd-abc3-3d0acde4af63_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/3f/d83fa720d653d42f5c7921e99d96d2f6/pa/WN35442_66573519c978fc5778b8d238873263c9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Expression Clim',
 'transmission': 'manual',
 'trim': 'Expression Clim',
 'year': 2012}
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN35442%27 HTTP/1.1" 200 None
2026-03-27 20:33:40 [auto1.be] INFO: Saving data for WN35442: {'created_time': 1774643620.728847, 'last_price_update_time': 1774643620.728865, 'auction_closing_time': 1774714390.0}
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WN35442') HTTP/1.1" 204 0
2026-03-27 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW74184> (referer: https://www.auto1.com/v1/car-details-view/AW74184/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_b2486fca784bc07c3e7a0db71e67e3e0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35295b790>
2026-03-27 20:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_e95f3dac7ab8f08da922c3616cc1d4ce.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_e95f3dac7ab8f08da922c3616cc1d4ce.jpg saved to cache
2026-03-27 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8
2026-03-27 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_7c164605b40bb21de63c47b2b664871c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_ab79c161c6f4e5f7f631371bb7bdb957.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_64215d7bb16e7444567298687d2bd84c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_679738775c9783117664ff46397a60b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_bf1c30b18b944e711a2cda8c96c28a6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_6e8fbe8f3e1b40f346d3b7595bd624e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184
2026-03-27 20:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27685742-f930-5c5f-94e2-21bc3d30f61d with scrape type 1
2026-03-27 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27685742-f930-5c5f-94e2-21bc3d30f61d
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_431af3fc0a89ff2935b77daf636b20b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_431af3fc0a89ff2935b77daf636b20b8.jpg not downloaded yet
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_1b7190081fcda16299245cd0dbefd993.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_1b7190081fcda16299245cd0dbefd993.jpg not downloaded yet
2026-03-27 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_23687565906fa1e1e59458db5ccca592.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_e1c79ddf64e9e2329df1c6a9539a924e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e1c79ddf64e9e2329df1c6a9539a924e.jpg not downloaded yet
2026-03-27 20:33:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352925090>
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_b2486fca784bc07c3e7a0db71e67e3e0.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_b2486fca784bc07c3e7a0db71e67e3e0.jpg saved to cache
2026-03-27 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc
2026-03-27 20:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_9e909e598c3da8a22b60f47e89348812.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_5c36a667fa8342e28f73dd90c2cf6be5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_fe70ea296edad623a88b9435425e3177.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_fe70ea296edad623a88b9435425e3177.jpg not downloaded yet
2026-03-27 20:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_d5b3e32f4c5abe2709d003379bf47ade.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_e846d380c7578c50c42249be7b297e5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e846d380c7578c50c42249be7b297e5f.jpg not downloaded yet
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352954b50>
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_7c164605b40bb21de63c47b2b664871c.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_7c164605b40bb21de63c47b2b664871c.jpg saved to cache
2026-03-27 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5ba6dc9-777f-50d9-b52a-e53f65750e9b
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353466250>
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_ab79c161c6f4e5f7f631371bb7bdb957.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_ab79c161c6f4e5f7f631371bb7bdb957.jpg saved to cache
2026-03-27 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8
2026-03-27 20:33:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353575a10>
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_64215d7bb16e7444567298687d2bd84c.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_64215d7bb16e7444567298687d2bd84c.jpg saved to cache
2026-03-27 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8
2026-03-27 20:33:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534679d0>
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_679738775c9783117664ff46397a60b8.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_679738775c9783117664ff46397a60b8.jpg saved to cache
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc
2026-03-27 20:33:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534ac850>
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_bf1c30b18b944e711a2cda8c96c28a6e.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_bf1c30b18b944e711a2cda8c96c28a6e.jpg saved to cache
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8
2026-03-27 20:33:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352979450>
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_6e8fbe8f3e1b40f346d3b7595bd624e3.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_6e8fbe8f3e1b40f346d3b7595bd624e3.jpg saved to cache
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529aea10>
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_23687565906fa1e1e59458db5ccca592.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_23687565906fa1e1e59458db5ccca592.jpg saved to cache
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_99ece313d96304053086ec7c436a12cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_99ece313d96304053086ec7c436a12cf.jpg not downloaded yet
2026-03-27 20:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_4bef09a984d27a7b0161808a2e78c2dc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_b075f5d67ab0bb5419818309dab39679.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_e3cbffb9aedd819c04dbd48713753f32.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e3cbffb9aedd819c04dbd48713753f32.jpg not downloaded yet
2026-03-27 20:33:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ad92d0>
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_9e909e598c3da8a22b60f47e89348812.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_9e909e598c3da8a22b60f47e89348812.jpg saved to cache
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5ba6dc9-777f-50d9-b52a-e53f65750e9b
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35298d9d0>
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_5c36a667fa8342e28f73dd90c2cf6be5.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_5c36a667fa8342e28f73dd90c2cf6be5.jpg saved to cache
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5ba6dc9-777f-50d9-b52a-e53f65750e9b
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35298e890>
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_d5b3e32f4c5abe2709d003379bf47ade.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_d5b3e32f4c5abe2709d003379bf47ade.jpg saved to cache
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5ba6dc9-777f-50d9-b52a-e53f65750e9b
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_5aa10e0e514ec8a2e60124f065a546e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_5aa10e0e514ec8a2e60124f065a546e7.jpg not downloaded yet
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_22e7aaf17fb01f87711cd9d4d3fe8ceb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_22e7aaf17fb01f87711cd9d4d3fe8ceb.jpg not downloaded yet
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_b4b3e415096a4dea6f48cb8e839d24be.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_b4b3e415096a4dea6f48cb8e839d24be.jpg not downloaded yet
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35288fcd0>
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_4bef09a984d27a7b0161808a2e78c2dc.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_4bef09a984d27a7b0161808a2e78c2dc.jpg saved to cache
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ae87d0>
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_b075f5d67ab0bb5419818309dab39679.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_b075f5d67ab0bb5419818309dab39679.jpg saved to cache
2026-03-27 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5ba6dc9-777f-50d9-b52a-e53f65750e9b
2026-03-27 20:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e846d380c7578c50c42249be7b297e5f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_0966bf57a52a05fa485313bb4a3d2893.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_d1c75580caaa3a66fac7a985d42d44ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_6046a031234e41e582ecc69710923776.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_7a19c9b5fd20c2271cbc6729fe6d9cfb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_181db3e15197ada02f951c44207b5820.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_fe70ea296edad623a88b9435425e3177.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_99ece313d96304053086ec7c436a12cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_4ecee00cd5d138b64301d22c34593a7e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e1c79ddf64e9e2329df1c6a9539a924e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35342a210>
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_e846d380c7578c50c42249be7b297e5f.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e846d380c7578c50c42249be7b297e5f.jpg saved to cache
2026-03-27 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27685742-f930-5c5f-94e2-21bc3d30f61d
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_a78b9eac126e8b4e775cb8871fc9083c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_281464dcf87a601ae75ed656791207c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_1b7190081fcda16299245cd0dbefd993.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_431af3fc0a89ff2935b77daf636b20b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_22e7aaf17fb01f87711cd9d4d3fe8ceb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353539950>
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_0966bf57a52a05fa485313bb4a3d2893.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_0966bf57a52a05fa485313bb4a3d2893.jpg saved to cache
2026-03-27 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc
2026-03-27 20:33:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb367538b50>
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_d1c75580caaa3a66fac7a985d42d44ec.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_d1c75580caaa3a66fac7a985d42d44ec.jpg saved to cache
2026-03-27 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc
2026-03-27 20:33:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35280f950>
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_6046a031234e41e582ecc69710923776.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_6046a031234e41e582ecc69710923776.jpg saved to cache
2026-03-27 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8
2026-03-27 20:33:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352864ed0>
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_7a19c9b5fd20c2271cbc6729fe6d9cfb.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_7a19c9b5fd20c2271cbc6729fe6d9cfb.jpg saved to cache
2026-03-27 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc
2026-03-27 20:33:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35280de90>
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb7%252F0bb7b675240fc95c382e47fb3e4cd458%252Fpa%252FYF30387_181db3e15197ada02f951c44207b5820.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_181db3e15197ada02f951c44207b5820.jpg saved to cache
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc
2026-03-27 20:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aff36c0b-bcf9-52e0-9032-6e7f118b17cc, skipping ID generation
2026-03-27 20:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc with scrape type 1
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc sending to next pipeline
2026-03-27 20:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aff36c0b-bcf9-52e0-9032-6e7f118b17cc, identifier: YF30387
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35285fad0>
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_fe70ea296edad623a88b9435425e3177.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_fe70ea296edad623a88b9435425e3177.jpg saved to cache
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27685742-f930-5c5f-94e2-21bc3d30f61d
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ac3c50>
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_99ece313d96304053086ec7c436a12cf.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_99ece313d96304053086ec7c436a12cf.jpg saved to cache
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27685742-f930-5c5f-94e2-21bc3d30f61d
2026-03-27 20:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387
2026-03-27 20:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387
2026-03-27 20:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387 to the API
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_181db3e15197ada02f951c44207b5820.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:20:29Z',
 'fuel_type': 'diesel',
 'id': 'aff36c0b-bcf9-52e0-9032-6e7f118b17cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF30387',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 178201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2789503,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_b2486fca784bc07c3e7a0db71e67e3e0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847923,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_181db3e15197ada02f951c44207b5820.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2935406,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_7a19c9b5fd20c2271cbc6729fe6d9cfb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_0089a6e1442c8728fd9ae0fa36f48af7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2810503,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_d1c75580caaa3a66fac7a985d42d44ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2895044,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_0966bf57a52a05fa485313bb4a3d2893.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_3c81367b5d83c47ef36a52cae2a4e944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3019094,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_6e8fbe8f3e1b40f346d3b7595bd624e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2858730,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_679738775c9783117664ff46397a60b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff36c0b-bcf9-52e0-9032-6e7f118b17cc/aff36c0b-bcf9-52e0-9032-6e7f118b17cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b7/0bb7b675240fc95c382e47fb3e4cd458/pa/YF30387_4ad4f04bc3fd854dc4d337ded4e7fde2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2016}
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-27 20:33:44 [auto1.be] INFO: Saving data for YF30387: {'created_time': 1774643624.717016, 'last_price_update_time': 1774643624.71703, 'auction_closing_time': 1774714829.0}
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YF30387') HTTP/1.1" 204 0
2026-03-27 20:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_b4b3e415096a4dea6f48cb8e839d24be.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529ad1d0>
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_4ecee00cd5d138b64301d22c34593a7e.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_4ecee00cd5d138b64301d22c34593a7e.jpg saved to cache
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534b2d50>
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_e1c79ddf64e9e2329df1c6a9539a924e.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e1c79ddf64e9e2329df1c6a9539a924e.jpg saved to cache
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27685742-f930-5c5f-94e2-21bc3d30f61d
2026-03-27 20:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW15988> (referer: https://www.auto1.com/v1/car-details-view/KW15988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352939690>
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb2%252Fc1b215b861ba5dd29a2c85e9de1870fa%252Fpa%252FUD25678_a78b9eac126e8b4e775cb8871fc9083c.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_a78b9eac126e8b4e775cb8871fc9083c.jpg saved to cache
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5ba6dc9-777f-50d9-b52a-e53f65750e9b
2026-03-27 20:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5ba6dc9-777f-50d9-b52a-e53f65750e9b, skipping ID generation
2026-03-27 20:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5ba6dc9-777f-50d9-b52a-e53f65750e9b with scrape type 1
2026-03-27 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5ba6dc9-777f-50d9-b52a-e53f65750e9b sending to next pipeline
2026-03-27 20:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a5ba6dc9-777f-50d9-b52a-e53f65750e9b, identifier: UD25678
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35368ffd0>
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F3f%252F0c3f31cae10fedbf6d249351ab6ba8f7%252Fpa%252FPT26763_281464dcf87a601ae75ed656791207c3.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_281464dcf87a601ae75ed656791207c3.jpg saved to cache
2026-03-27 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 587ea13f-532d-5194-a614-83d6c952f2dc
2026-03-27 20:33:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 587ea13f-532d-5194-a614-83d6c952f2dc, skipping ID generation
2026-03-27 20:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587ea13f-532d-5194-a614-83d6c952f2dc with scrape type 1
2026-03-27 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 587ea13f-532d-5194-a614-83d6c952f2dc sending to next pipeline
2026-03-27 20:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 587ea13f-532d-5194-a614-83d6c952f2dc, identifier: PT26763
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352938050>
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_1b7190081fcda16299245cd0dbefd993.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_1b7190081fcda16299245cd0dbefd993.jpg saved to cache
2026-03-27 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27685742-f930-5c5f-94e2-21bc3d30f61d
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35281df90>
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_431af3fc0a89ff2935b77daf636b20b8.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_431af3fc0a89ff2935b77daf636b20b8.jpg saved to cache
2026-03-27 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27685742-f930-5c5f-94e2-21bc3d30f61d
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ab7610>
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_22e7aaf17fb01f87711cd9d4d3fe8ceb.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_22e7aaf17fb01f87711cd9d4d3fe8ceb.jpg saved to cache
2026-03-27 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27685742-f930-5c5f-94e2-21bc3d30f61d
2026-03-27 20:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a5ba6dc9-777f-50d9-b52a-e53f65750e9b with identifier: UD25678
2026-03-27 20:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a5ba6dc9-777f-50d9-b52a-e53f65750e9b with identifier: UD25678
2026-03-27 20:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a5ba6dc9-777f-50d9-b52a-e53f65750e9b with identifier: UD25678 to the API
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_a78b9eac126e8b4e775cb8871fc9083c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:00:15Z',
 'fuel_type': 'petrol',
 'id': 'a5ba6dc9-777f-50d9-b52a-e53f65750e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD25678',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 89500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_a78b9eac126e8b4e775cb8871fc9083c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_b075f5d67ab0bb5419818309dab39679.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_9e909e598c3da8a22b60f47e89348812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_5c36a667fa8342e28f73dd90c2cf6be5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_d5b3e32f4c5abe2709d003379bf47ade.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ba6dc9-777f-50d9-b52a-e53f65750e9b/a5ba6dc9-777f-50d9-b52a-e53f65750e9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b2/c1b215b861ba5dd29a2c85e9de1870fa/pa/UD25678_7c164605b40bb21de63c47b2b664871c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD25678%27 HTTP/1.1" 200 None
2026-03-27 20:33:45 [auto1.be] INFO: Saving data for UD25678: {'created_time': 1774643625.792612, 'last_price_update_time': 1774643625.792623, 'auction_closing_time': 1774713615.0}
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UD25678') HTTP/1.1" 204 0
2026-03-27 20:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763
2026-03-27 20:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763
2026-03-27 20:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763 to the API
2026-03-27 20:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_281464dcf87a601ae75ed656791207c3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:43:58Z',
 'fuel_type': 'diesel',
 'id': '587ea13f-532d-5194-a614-83d6c952f2dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT26763',
 'listing': 'auction',
 'location': 'BE, Torhout',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 175344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_a929567275a4f505faea9a75e639bd69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_c8b7a6907748ca772e2610a7dd84cb44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_044c2fb297ce5cc7608d827dbee0ff5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_331df7c6619e46148823a62c9f5ca9c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_8512b6849df3e5b97c9dfcf5734a3a8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_abec6dc71da1f657c9d35f95caea4c1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_88085993d46951d39d50b0b608de1427.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_281464dcf87a601ae75ed656791207c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_c90f6abd4f1d8fb2f94a0e6e53f517ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587ea13f-532d-5194-a614-83d6c952f2dc/587ea13f-532d-5194-a614-83d6c952f2dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/3f/0c3f31cae10fedbf6d249351ab6ba8f7/pa/PT26763_b95e152bceb4a5e2af104cc149146f3c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueTEC Avantgarde',
 'year': 2015}
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-27 20:33:46 [auto1.be] INFO: Saving data for PT26763: {'created_time': 1774643626.180468, 'last_price_update_time': 1774643626.180478, 'auction_closing_time': 1774716238.0}
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PT26763') HTTP/1.1" 204 0
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529f7d50>
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_b4b3e415096a4dea6f48cb8e839d24be.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_b4b3e415096a4dea6f48cb8e839d24be.jpg saved to cache
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27685742-f930-5c5f-94e2-21bc3d30f61d
2026-03-27 20:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988
2026-03-27 20:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23368f7c-db3c-5569-ae22-58c4b42cf036 with scrape type 1
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23368f7c-db3c-5569-ae22-58c4b42cf036
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_14cce0a20fb201da71df5dafde385510.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_14cce0a20fb201da71df5dafde385510.jpg not downloaded yet
2026-03-27 20:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e3cbffb9aedd819c04dbd48713753f32.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_5aa10e0e514ec8a2e60124f065a546e7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_26270221ce88dbe882b66dbbf9712078.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_26270221ce88dbe882b66dbbf9712078.jpg not downloaded yet
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_5d173314867621902a3e95e820aae3e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_5d173314867621902a3e95e820aae3e7.jpg not downloaded yet
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_da6b30c34450e0982a6d7f91e49b9352.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_da6b30c34450e0982a6d7f91e49b9352.jpg not downloaded yet
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_7c0369c74ff6ff9ad37a12a74edf85db.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_7c0369c74ff6ff9ad37a12a74edf85db.jpg not downloaded yet
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_effee57bfcd0a2b2ebe155dd69e45351.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_effee57bfcd0a2b2ebe155dd69e45351.jpg not downloaded yet
2026-03-27 20:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_14cce0a20fb201da71df5dafde385510.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a6c950>
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_e3cbffb9aedd819c04dbd48713753f32.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e3cbffb9aedd819c04dbd48713753f32.jpg saved to cache
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27685742-f930-5c5f-94e2-21bc3d30f61d
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529d2c90>
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F57%252F7857989e03789f70f5f79bd5d824f14b%252Fpa%252FAW74184_5aa10e0e514ec8a2e60124f065a546e7.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_5aa10e0e514ec8a2e60124f065a546e7.jpg saved to cache
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27685742-f930-5c5f-94e2-21bc3d30f61d
2026-03-27 20:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27685742-f930-5c5f-94e2-21bc3d30f61d, skipping ID generation
2026-03-27 20:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27685742-f930-5c5f-94e2-21bc3d30f61d with scrape type 1
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27685742-f930-5c5f-94e2-21bc3d30f61d sending to next pipeline
2026-03-27 20:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 27685742-f930-5c5f-94e2-21bc3d30f61d, identifier: AW74184
2026-03-27 20:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_5d173314867621902a3e95e820aae3e7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_26270221ce88dbe882b66dbbf9712078.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_c0a4f6b79f0539a928145b1a099a9f55.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_c0a4f6b79f0539a928145b1a099a9f55.jpg not downloaded yet
2026-03-27 20:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184
2026-03-27 20:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184
2026-03-27 20:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184 to the API
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_5aa10e0e514ec8a2e60124f065a546e7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:08:11Z',
 'fuel_type': 'diesel',
 'id': '27685742-f930-5c5f-94e2-21bc3d30f61d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW74184',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 146147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_431af3fc0a89ff2935b77daf636b20b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_1b7190081fcda16299245cd0dbefd993.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e1c79ddf64e9e2329df1c6a9539a924e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_fe70ea296edad623a88b9435425e3177.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e846d380c7578c50c42249be7b297e5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_99ece313d96304053086ec7c436a12cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_e3cbffb9aedd819c04dbd48713753f32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_5aa10e0e514ec8a2e60124f065a546e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_22e7aaf17fb01f87711cd9d4d3fe8ceb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27685742-f930-5c5f-94e2-21bc3d30f61d/27685742-f930-5c5f-94e2-21bc3d30f61d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/57/7857989e03789f70f5f79bd5d824f14b/pa/AW74184_b4b3e415096a4dea6f48cb8e839d24be.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Active",
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2019}
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-27 20:33:46 [auto1.be] INFO: Saving data for AW74184: {'created_time': 1774643626.940804, 'last_price_update_time': 1774643626.940814, 'auction_closing_time': 1774714091.0}
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AW74184') HTTP/1.1" 204 0
2026-03-27 20:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_da6b30c34450e0982a6d7f91e49b9352.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_5ae68205e7499e60d00bc0c339ba2dd4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_5ae68205e7499e60d00bc0c339ba2dd4.jpg not downloaded yet
2026-03-27 20:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_7c0369c74ff6ff9ad37a12a74edf85db.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536f3990>
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_14cce0a20fb201da71df5dafde385510.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_14cce0a20fb201da71df5dafde385510.jpg saved to cache
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23368f7c-db3c-5569-ae22-58c4b42cf036
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35282a490>
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_5d173314867621902a3e95e820aae3e7.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_5d173314867621902a3e95e820aae3e7.jpg saved to cache
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23368f7c-db3c-5569-ae22-58c4b42cf036
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353692690>
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_26270221ce88dbe882b66dbbf9712078.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_26270221ce88dbe882b66dbbf9712078.jpg saved to cache
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23368f7c-db3c-5569-ae22-58c4b42cf036
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_16dff8cbaa9b4a8cc29518652f284705.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_16dff8cbaa9b4a8cc29518652f284705.jpg not downloaded yet
2026-03-27 20:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_effee57bfcd0a2b2ebe155dd69e45351.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_da1c27762727d463f68b99c0891f96dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_da1c27762727d463f68b99c0891f96dd.jpg not downloaded yet
2026-03-27 20:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3671de950>
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_da6b30c34450e0982a6d7f91e49b9352.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_da6b30c34450e0982a6d7f91e49b9352.jpg saved to cache
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23368f7c-db3c-5569-ae22-58c4b42cf036
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536f30d0>
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_7c0369c74ff6ff9ad37a12a74edf85db.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_7c0369c74ff6ff9ad37a12a74edf85db.jpg saved to cache
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23368f7c-db3c-5569-ae22-58c4b42cf036
2026-03-27 20:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_cbb60691cb5a0152ed9dc28b619a4f15.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_c0a4f6b79f0539a928145b1a099a9f55.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35285d710>
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_effee57bfcd0a2b2ebe155dd69e45351.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_effee57bfcd0a2b2ebe155dd69e45351.jpg saved to cache
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23368f7c-db3c-5569-ae22-58c4b42cf036
2026-03-27 20:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_5ae68205e7499e60d00bc0c339ba2dd4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_16dff8cbaa9b4a8cc29518652f284705.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_da1c27762727d463f68b99c0891f96dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:47 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1659 | hits on page: 40
2026-03-27 20:33:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534a5010>
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fdb%252Fcadba549b18c7809f38f43a6c56f030f%252Fpa%252FHH24769_cbb60691cb5a0152ed9dc28b619a4f15.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_cbb60691cb5a0152ed9dc28b619a4f15.jpg saved to cache
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8
2026-03-27 20:33:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63bf927a-c95c-5e4d-a667-a96f479ae7b8, skipping ID generation
2026-03-27 20:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with scrape type 1
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8 sending to next pipeline
2026-03-27 20:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63bf927a-c95c-5e4d-a667-a96f479ae7b8, identifier: HH24769
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352982390>
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_c0a4f6b79f0539a928145b1a099a9f55.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_c0a4f6b79f0539a928145b1a099a9f55.jpg saved to cache
2026-03-27 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23368f7c-db3c-5569-ae22-58c4b42cf036
2026-03-27 20:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769
2026-03-27 20:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769
2026-03-27 20:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769 to the API
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_cbb60691cb5a0152ed9dc28b619a4f15.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:36:25Z',
 'fuel_type': 'diesel',
 'id': '63bf927a-c95c-5e4d-a667-a96f479ae7b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH24769',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 138785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3007931,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_cbb60691cb5a0152ed9dc28b619a4f15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3083998,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_4ecee00cd5d138b64301d22c34593a7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_4bef09a984d27a7b0161808a2e78c2dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2855641,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_6046a031234e41e582ecc69710923776.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_23687565906fa1e1e59458db5ccca592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_ab79c161c6f4e5f7f631371bb7bdb957.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2723812,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_bf1c30b18b944e711a2cda8c96c28a6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_e95f3dac7ab8f08da922c3616cc1d4ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2714693,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_64215d7bb16e7444567298687d2bd84c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63bf927a-c95c-5e4d-a667-a96f479ae7b8/63bf927a-c95c-5e4d-a667-a96f479ae7b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/db/cadba549b18c7809f38f43a6c56f030f/pa/HH24769_74b86acfeb00c03e7ac84c1b8f788c71.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-27 20:33:47 [auto1.be] INFO: Saving data for HH24769: {'created_time': 1774643627.944707, 'last_price_update_time': 1774643627.944717, 'auction_closing_time': 1774715785.0}
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH24769') HTTP/1.1" 204 0
2026-03-27 20:33:47 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-27 20:33:47 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-27 20:33:47 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-27 20:33:47 [auto1.be] INFO: Found listing with ID: VK87411
2026-03-27 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK87411%27 HTTP/1.1" 200 None
2026-03-27 20:33:48 [auto1.be] INFO: Scrape type for VK87411: 1
2026-03-27 20:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-27 20:33:48 [auto1.be] INFO: Scrape type for ZT52703: 1
2026-03-27 20:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3528548d0>
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_5ae68205e7499e60d00bc0c339ba2dd4.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_5ae68205e7499e60d00bc0c339ba2dd4.jpg saved to cache
2026-03-27 20:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23368f7c-db3c-5569-ae22-58c4b42cf036
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35351d190>
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_16dff8cbaa9b4a8cc29518652f284705.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_16dff8cbaa9b4a8cc29518652f284705.jpg saved to cache
2026-03-27 20:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23368f7c-db3c-5569-ae22-58c4b42cf036
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352938410>
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa5%252Fe9a56508f32e21e926da307a0dcb0442%252Fpa%252FKW15988_da1c27762727d463f68b99c0891f96dd.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_da1c27762727d463f68b99c0891f96dd.jpg saved to cache
2026-03-27 20:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23368f7c-db3c-5569-ae22-58c4b42cf036
2026-03-27 20:33:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23368f7c-db3c-5569-ae22-58c4b42cf036, skipping ID generation
2026-03-27 20:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23368f7c-db3c-5569-ae22-58c4b42cf036 with scrape type 1
2026-03-27 20:33:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23368f7c-db3c-5569-ae22-58c4b42cf036 sending to next pipeline
2026-03-27 20:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23368f7c-db3c-5569-ae22-58c4b42cf036, identifier: KW15988
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-27 20:33:48 [auto1.be] INFO: Scrape type for RK68346: 1
2026-03-27 20:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988
2026-03-27 20:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988
2026-03-27 20:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988 to the API
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_da1c27762727d463f68b99c0891f96dd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:18:20Z',
 'fuel_type': 'petrol',
 'id': '23368f7c-db3c-5569-ae22-58c4b42cf036',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW15988',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 147402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_14cce0a20fb201da71df5dafde385510.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_26270221ce88dbe882b66dbbf9712078.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_5d173314867621902a3e95e820aae3e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_da6b30c34450e0982a6d7f91e49b9352.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_7c0369c74ff6ff9ad37a12a74edf85db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_effee57bfcd0a2b2ebe155dd69e45351.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_c0a4f6b79f0539a928145b1a099a9f55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_5ae68205e7499e60d00bc0c339ba2dd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_16dff8cbaa9b4a8cc29518652f284705.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23368f7c-db3c-5569-ae22-58c4b42cf036/23368f7c-db3c-5569-ae22-58c4b42cf036_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a5/e9a56508f32e21e926da307a0dcb0442/pa/KW15988_da1c27762727d463f68b99c0891f96dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-27 20:33:48 [auto1.be] INFO: Saving data for KW15988: {'created_time': 1774643628.565388, 'last_price_update_time': 1774643628.565398, 'auction_closing_time': 1774714700.0}
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW15988') HTTP/1.1" 204 0
2026-03-27 20:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: HH43502
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-27 20:33:48 [auto1.be] INFO: Scrape type for ZL81412: 1
2026-03-27 20:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: CE21828
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: JR17508
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: RK20492
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK20492%27 HTTP/1.1" 200 None
2026-03-27 20:33:48 [auto1.be] INFO: Scrape type for RK20492: 1
2026-03-27 20:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-27 20:33:48 [auto1.be] INFO: Scrape type for RM51088: 1
2026-03-27 20:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: LF48909
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF48909%27 HTTP/1.1" 200 None
2026-03-27 20:33:48 [auto1.be] INFO: Scrape type for LF48909: 1
2026-03-27 20:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:48 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-27 20:33:48 [auto1.be] INFO: Scrape type for FS62191: 2
2026-03-27 20:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191
2026-03-27 20:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c773424-bccf-594a-b9f2-3927cc0e113c with scrape type 2
2026-03-27 20:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c773424-bccf-594a-b9f2-3927cc0e113c with scrape type 2
2026-03-27 20:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5c773424-bccf-594a-b9f2-3927cc0e113c, identifier: FS62191
2026-03-27 20:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191
2026-03-27 20:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191
2026-03-27 20:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191 to the API
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:32:55Z',
 'fuel_type': 'petrol',
 'id': '5c773424-bccf-594a-b9f2-3927cc0e113c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS62191',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 93400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20i Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-27 20:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-27 20:33:49 [auto1.be] INFO: Saving data for FS62191: {'auction_closing_time': 1774715575.0, 'created_time': 1773866601.069438, 'last_price_update_time': 1774643629.034582}
2026-03-27 20:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FS62191') HTTP/1.1" 204 0
2026-03-27 20:33:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:49 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-27 20:33:49 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-27 20:33:49 [auto1.be] INFO: Found listing with ID: MS34473
2026-03-27 20:33:49 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-27 20:33:49 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-27 20:33:49 [auto1.be] INFO: Found listing with ID: MF52944
2026-03-27 20:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF52944%27 HTTP/1.1" 200 None
2026-03-27 20:33:49 [auto1.be] INFO: Scrape type for MF52944: 1
2026-03-27 20:33:49 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-27 20:33:49 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-27 20:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-27 20:33:49 [auto1.be] INFO: Scrape type for NY99560: 1
2026-03-27 20:33:49 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-27 20:33:49 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-27 20:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-27 20:33:49 [auto1.be] INFO: Scrape type for LJ91533: 1
2026-03-27 20:33:49 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-27 20:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM51088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT52703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL81412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK87411/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK20492/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK68346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF48909/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF52944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:50 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1659 | hits on page: 40
2026-03-27 20:33:50 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-27 20:33:50 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-27 20:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-27 20:33:50 [auto1.be] INFO: Scrape type for AF71611: 2
2026-03-27 20:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611
2026-03-27 20:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aebb3b2-a202-50dc-b817-b9d631831bd9 with scrape type 2
2026-03-27 20:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aebb3b2-a202-50dc-b817-b9d631831bd9 with scrape type 2
2026-03-27 20:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9aebb3b2-a202-50dc-b817-b9d631831bd9, identifier: AF71611
2026-03-27 20:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611
2026-03-27 20:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611
2026-03-27 20:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611 to the API
2026-03-27 20:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-28T16:25:27Z',
 'fuel_type': 'hybrid',
 'id': '9aebb3b2-a202-50dc-b817-b9d631831bd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF71611',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 172156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-03',
 'seller_name': None,
 'title': 'BMW 7er 745e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-27 20:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-27 20:33:50 [auto1.be] INFO: Saving data for AF71611: {'auction_closing_time': 1774715127.0, 'created_time': 1773952873.549187, 'last_price_update_time': 1774643630.878774}
2026-03-27 20:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AF71611') HTTP/1.1" 204 0
2026-03-27 20:33:50 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-27 20:33:50 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-27 20:33:50 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-27 20:33:50 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-27 20:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-27 20:33:50 [auto1.be] INFO: Scrape type for UU12218: 1
2026-03-27 20:33:50 [auto1.be] INFO: Found listing with ID: KZ70715
2026-03-27 20:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ70715%27 HTTP/1.1" 200 None
2026-03-27 20:33:51 [auto1.be] INFO: Scrape type for KZ70715: 1
2026-03-27 20:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY99560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ91533/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM51088> (referer: https://www.auto1.com/v1/car-details-view/RM51088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: WW24606
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-27 20:33:51 [auto1.be] INFO: Scrape type for WU43595: 2
2026-03-27 20:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595
2026-03-27 20:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca14168e-cc49-55ea-8119-9684b8ea4f0a with scrape type 2
2026-03-27 20:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca14168e-cc49-55ea-8119-9684b8ea4f0a with scrape type 2
2026-03-27 20:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca14168e-cc49-55ea-8119-9684b8ea4f0a, identifier: WU43595
2026-03-27 20:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595
2026-03-27 20:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595
2026-03-27 20:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595 to the API
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-28T16:32:51Z',
 'fuel_type': 'diesel',
 'id': 'ca14168e-cc49-55ea-8119-9684b8ea4f0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU43595',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 35619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2021}
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-27 20:33:51 [auto1.be] INFO: Saving data for WU43595: {'auction_closing_time': 1774715571.0, 'created_time': 1773520257.455045, 'last_price_update_time': 1774643631.379894}
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WU43595') HTTP/1.1" 204 0
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-27 20:33:51 [auto1.be] INFO: Scrape type for HG61894: 1
2026-03-27 20:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT52703> (referer: https://www.auto1.com/v1/car-details-view/ZT52703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL81412> (referer: https://www.auto1.com/v1/car-details-view/ZL81412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088
2026-03-27 20:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c4b978-7553-5b88-b410-5d869264a521 with scrape type 1
2026-03-27 20:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78c4b978-7553-5b88-b410-5d869264a521
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_29ebe23b2a4f3e1c253acb657057d99d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_29ebe23b2a4f3e1c253acb657057d99d.jpg not downloaded yet
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: VF96553
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: TR55859
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-27 20:33:51 [auto1.be] INFO: Scrape type for EX56301: 1
2026-03-27 20:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK87411> (referer: https://www.auto1.com/v1/car-details-view/VK87411/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_7e295af29b1f8a957b1cca19bdad5542.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_7e295af29b1f8a957b1cca19bdad5542.jpg not downloaded yet
2026-03-27 20:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: SL68944
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-27 20:33:51 [auto1.be] INFO: Scrape type for LE66186: 1
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_732f30d299a014ca6e36e247417f99d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_732f30d299a014ca6e36e247417f99d5.jpg not downloaded yet
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-27 20:33:51 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-27 20:33:51 [auto1.be] INFO: Scrape type for LA76788: 2
2026-03-27 20:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788
2026-03-27 20:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with scrape type 2
2026-03-27 20:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with scrape type 2
2026-03-27 20:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640, identifier: LA76788
2026-03-27 20:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788
2026-03-27 20:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788
2026-03-27 20:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788 to the API
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:47:27Z',
 'fuel_type': 'diesel',
 'id': 'b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA76788',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 129227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-04',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2016}
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-27 20:33:51 [auto1.be] INFO: Saving data for LA76788: {'auction_closing_time': 1774716447.0, 'created_time': 1773866557.317288, 'last_price_update_time': 1774643631.973725}
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LA76788') HTTP/1.1" 204 0
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_d89aded0b3f0ae9e75253f0ed9764f40.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_d89aded0b3f0ae9e75253f0ed9764f40.jpg not downloaded yet
2026-03-27 20:33:52 [auto1.be] INFO: Found listing with ID: XL87749
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL87749%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [auto1.be] INFO: Scrape type for XL87749: 1
2026-03-27 20:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703
2026-03-27 20:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7feb9c2c-cc83-5421-930e-834c5bfd5694 with scrape type 1
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7feb9c2c-cc83-5421-930e-834c5bfd5694
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_75d4e0d5097cf9c76ae949eea448b58c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_75d4e0d5097cf9c76ae949eea448b58c.jpg not downloaded yet
2026-03-27 20:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412
2026-03-27 20:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with scrape type 1
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F93%252Ff893fddd4f402d145d682d024c3c1cc7%252Fpa%252FZL81412_751beaf4b8ff93872e485c0bab9b1c63.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_751beaf4b8ff93872e485c0bab9b1c63.jpg already downloaded
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F93%252Ff893fddd4f402d145d682d024c3c1cc7%252Fpa%252FZL81412_cff3dae3ef978551503b04b47a82a4e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_cff3dae3ef978551503b04b47a82a4e4.jpg already downloaded
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F93%252Ff893fddd4f402d145d682d024c3c1cc7%252Fpa%252FZL81412_410d8d0438d1274bbe5df6dda99fe405.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_410d8d0438d1274bbe5df6dda99fe405.jpg already downloaded
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F93%252Ff893fddd4f402d145d682d024c3c1cc7%252Fpa%252FZL81412_cacf123ed6323cda0998450179f73748.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_cacf123ed6323cda0998450179f73748.jpg already downloaded
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F93%252Ff893fddd4f402d145d682d024c3c1cc7%252Fpa%252FZL81412_0919a6f80aeadbdef14a4b41db3c50ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_0919a6f80aeadbdef14a4b41db3c50ef.jpg already downloaded
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F93%252Ff893fddd4f402d145d682d024c3c1cc7%252Fpa%252FZL81412_61a44a41e08aa3eb410e11a4c0fb3a29.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_61a44a41e08aa3eb410e11a4c0fb3a29.jpg already downloaded
2026-03-27 20:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc, identifier: ZL81412
2026-03-27 20:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_29ebe23b2a4f3e1c253acb657057d99d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_b529622727c09051a5c569300f917af9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_b529622727c09051a5c569300f917af9.jpg not downloaded yet
2026-03-27 20:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412
2026-03-27 20:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412
2026-03-27 20:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412 to the API
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL81412>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '1.9L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:15:51Z',
 'fuel_type': 'diesel',
 'id': '5cb16b87-2305-5c8a-a5bf-34edabf5b9cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL81412',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 135478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_751beaf4b8ff93872e485c0bab9b1c63.jpg',
                'https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_cff3dae3ef978551503b04b47a82a4e4.jpg',
                'https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_410d8d0438d1274bbe5df6dda99fe405.jpg',
                'https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_cacf123ed6323cda0998450179f73748.jpg',
                'https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_0919a6f80aeadbdef14a4b41db3c50ef.jpg',
                'https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_61a44a41e08aa3eb410e11a4c0fb3a29.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cb16b87-2305-5c8a-a5bf-34edabf5b9cc/5cb16b87-2305-5c8a-a5bf-34edabf5b9cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_751beaf4b8ff93872e485c0bab9b1c63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cb16b87-2305-5c8a-a5bf-34edabf5b9cc/5cb16b87-2305-5c8a-a5bf-34edabf5b9cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_cff3dae3ef978551503b04b47a82a4e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cb16b87-2305-5c8a-a5bf-34edabf5b9cc/5cb16b87-2305-5c8a-a5bf-34edabf5b9cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_410d8d0438d1274bbe5df6dda99fe405.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cb16b87-2305-5c8a-a5bf-34edabf5b9cc/5cb16b87-2305-5c8a-a5bf-34edabf5b9cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_cacf123ed6323cda0998450179f73748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cb16b87-2305-5c8a-a5bf-34edabf5b9cc/5cb16b87-2305-5c8a-a5bf-34edabf5b9cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_0919a6f80aeadbdef14a4b41db3c50ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cb16b87-2305-5c8a-a5bf-34edabf5b9cc/5cb16b87-2305-5c8a-a5bf-34edabf5b9cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/93/f893fddd4f402d145d682d024c3c1cc7/pa/ZL81412_61a44a41e08aa3eb410e11a4c0fb3a29.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-03-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 SDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2003}
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [auto1.be] INFO: Saving data for ZL81412: {'created_time': 1774643632.708103, 'last_price_update_time': 1774643632.708115, 'auction_closing_time': 1774714551.0}
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL81412') HTTP/1.1" 204 0
2026-03-27 20:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9117a7d2-6ea7-56b3-863c-fd27deb06dcb with identifier: VK87411
2026-03-27 20:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9117a7d2-6ea7-56b3-863c-fd27deb06dcb with scrape type 1
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9117a7d2-6ea7-56b3-863c-fd27deb06dcb
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_6a57922ebb7e2a1633badeb4e4ae31a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_6a57922ebb7e2a1633badeb4e4ae31a4.jpg not downloaded yet
2026-03-27 20:33:52 [auto1.be] INFO: Found listing with ID: VV55176
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV55176%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [auto1.be] INFO: Scrape type for VV55176: 1
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_5dd521be9544fd5319b073008ee146f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_5dd521be9544fd5319b073008ee146f1.jpg not downloaded yet
2026-03-27 20:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_7e295af29b1f8a957b1cca19bdad5542.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_24731ea2a33052f5f7a6599a9c2e8663.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_24731ea2a33052f5f7a6599a9c2e8663.jpg not downloaded yet
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_a3eb01804adb869b821c82101e651271.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_a3eb01804adb869b821c82101e651271.jpg not downloaded yet
2026-03-27 20:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK20492> (referer: https://www.auto1.com/v1/car-details-view/RK20492/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_732f30d299a014ca6e36e247417f99d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:52 [auto1.be] INFO: Found listing with ID: CY69823
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY69823%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [auto1.be] INFO: Scrape type for CY69823: 1
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_419c777ad90074dd172c198f9110d6fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_419c777ad90074dd172c198f9110d6fa.jpg not downloaded yet
2026-03-27 20:33:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534b4590>
2026-03-27 20:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_29ebe23b2a4f3e1c253acb657057d99d.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_29ebe23b2a4f3e1c253acb657057d99d.jpg saved to cache
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78c4b978-7553-5b88-b410-5d869264a521
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_a73021e2556613bcf09c20331c334ef4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_a73021e2556613bcf09c20331c334ef4.jpg not downloaded yet
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_3088e81c83d10d7f59afd8a4009890c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_3088e81c83d10d7f59afd8a4009890c2.jpg not downloaded yet
2026-03-27 20:33:52 [auto1.be] INFO: Found listing with ID: BV68544
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV68544%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [auto1.be] INFO: Scrape type for BV68544: 1
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_c3a76d461d6b17d3cfcbc288c158402a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_c3a76d461d6b17d3cfcbc288c158402a.jpg not downloaded yet
2026-03-27 20:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_75d4e0d5097cf9c76ae949eea448b58c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_6ab36f713108b6e2fe10e4f9aa609454.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_6ab36f713108b6e2fe10e4f9aa609454.jpg not downloaded yet
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_4254d5b67d958302160c6ed67c3db8ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_4254d5b67d958302160c6ed67c3db8ec.jpg not downloaded yet
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35343bcd0>
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_7e295af29b1f8a957b1cca19bdad5542.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_7e295af29b1f8a957b1cca19bdad5542.jpg saved to cache
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78c4b978-7553-5b88-b410-5d869264a521
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_d89aded0b3f0ae9e75253f0ed9764f40.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_6a57922ebb7e2a1633badeb4e4ae31a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: CP59959
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [auto1.be] INFO: Scrape type for MV82025: 1
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_d50d420bc5efc3c0b1bf6ae9bef7db51.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_d50d420bc5efc3c0b1bf6ae9bef7db51.jpg not downloaded yet
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_5dd521be9544fd5319b073008ee146f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_b757a832b3e3cac8e24e6542a0ee88ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_b757a832b3e3cac8e24e6542a0ee88ba.jpg not downloaded yet
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_e7bf88a7883093054153d054d4fe90e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_e7bf88a7883093054153d054d4fe90e9.jpg not downloaded yet
2026-03-27 20:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80113859-0d8c-5c0c-b815-c99545b46316 with identifier: RK20492
2026-03-27 20:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80113859-0d8c-5c0c-b815-c99545b46316 with scrape type 1
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80113859-0d8c-5c0c-b815-c99545b46316
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_e18b9d8c582c70c0cac09eaeea41c077.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_e18b9d8c582c70c0cac09eaeea41c077.jpg not downloaded yet
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35353b250>
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_732f30d299a014ca6e36e247417f99d5.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_732f30d299a014ca6e36e247417f99d5.jpg saved to cache
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78c4b978-7553-5b88-b410-5d869264a521
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: ZU40891
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: PM95515
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [auto1.be] INFO: Scrape type for CS20047: 1
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_becb7d49a8e96c764aee9ac053a0ba46.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_becb7d49a8e96c764aee9ac053a0ba46.jpg not downloaded yet
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ae31d0>
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_75d4e0d5097cf9c76ae949eea448b58c.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_75d4e0d5097cf9c76ae949eea448b58c.jpg saved to cache
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7feb9c2c-cc83-5421-930e-834c5bfd5694
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_0ef61297b99600fdd371edf9ca74f507.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_0ef61297b99600fdd371edf9ca74f507.jpg not downloaded yet
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_8ae1d6d09f2355c9252c1c2e0f019629.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_8ae1d6d09f2355c9252c1c2e0f019629.jpg not downloaded yet
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_776a1cf1acf707667fa20a12b42aa468.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_776a1cf1acf707667fa20a12b42aa468.jpg not downloaded yet
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_c3a76d461d6b17d3cfcbc288c158402a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_3088e81c83d10d7f59afd8a4009890c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [auto1.be] INFO: Scrape type for HS49836: 1
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF48909> (referer: https://www.auto1.com/v1/car-details-view/LF48909/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35357cad0>
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_d89aded0b3f0ae9e75253f0ed9764f40.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_d89aded0b3f0ae9e75253f0ed9764f40.jpg saved to cache
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78c4b978-7553-5b88-b410-5d869264a521
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf5d10>
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_6a57922ebb7e2a1633badeb4e4ae31a4.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_6a57922ebb7e2a1633badeb4e4ae31a4.jpg saved to cache
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9117a7d2-6ea7-56b3-863c-fd27deb06dcb
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3535aead0>
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_5dd521be9544fd5319b073008ee146f1.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_5dd521be9544fd5319b073008ee146f1.jpg saved to cache
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7feb9c2c-cc83-5421-930e-834c5bfd5694
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_549a082e1d389a89de58b2d7ece7a775.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_549a082e1d389a89de58b2d7ece7a775.jpg not downloaded yet
2026-03-27 20:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_4254d5b67d958302160c6ed67c3db8ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [auto1.be] INFO: Scrape type for DY69036: 1
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_2f0199c8f8d5bf2b8c38f670a248ab48.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_2f0199c8f8d5bf2b8c38f670a248ab48.jpg not downloaded yet
2026-03-27 20:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ91533> (referer: https://www.auto1.com/v1/car-details-view/LJ91533/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU12218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35342bd10>
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_c3a76d461d6b17d3cfcbc288c158402a.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_c3a76d461d6b17d3cfcbc288c158402a.jpg saved to cache
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7feb9c2c-cc83-5421-930e-834c5bfd5694
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3595850d0>
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_3088e81c83d10d7f59afd8a4009890c2.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_3088e81c83d10d7f59afd8a4009890c2.jpg saved to cache
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9117a7d2-6ea7-56b3-863c-fd27deb06dcb
2026-03-27 20:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1dcdfc7-42e3-5f56-a936-9499ab8da017 with identifier: LF48909
2026-03-27 20:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1dcdfc7-42e3-5f56-a936-9499ab8da017 with scrape type 1
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1dcdfc7-42e3-5f56-a936-9499ab8da017
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_31b369da8eb5d4cb3fb61f69e3687807.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_31b369da8eb5d4cb3fb61f69e3687807.jpg not downloaded yet
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [auto1.be] INFO: Scrape type for DB02418: 1
2026-03-27 20:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF52944> (referer: https://www.auto1.com/v1/car-details-view/MF52944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_856b1681af7f31b329295944f2cddd0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_856b1681af7f31b329295944f2cddd0e.jpg not downloaded yet
2026-03-27 20:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_8098a60acb6044745b8badb28559a4f9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_8098a60acb6044745b8badb28559a4f9.jpg not downloaded yet
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_becb7d49a8e96c764aee9ac053a0ba46.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_776a1cf1acf707667fa20a12b42aa468.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: MA13965
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ70715/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ade090>
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_4254d5b67d958302160c6ed67c3db8ec.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_4254d5b67d958302160c6ed67c3db8ec.jpg saved to cache
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9117a7d2-6ea7-56b3-863c-fd27deb06dcb
2026-03-27 20:33:53 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1659 | hits on page: 40
2026-03-27 20:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533
2026-03-27 20:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7845b786-ced6-52e0-b98e-ad07e24228e2 with scrape type 1
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7845b786-ced6-52e0-b98e-ad07e24228e2
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_ae47281368e395fd6736b87d05c26d43.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_ae47281368e395fd6736b87d05c26d43.jpg not downloaded yet
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_661f9e307782a9d4272c4c654a796c83.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_661f9e307782a9d4272c4c654a796c83.jpg not downloaded yet
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_667469d7aa979fc4525c2e4784d298a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_667469d7aa979fc4525c2e4784d298a6.jpg not downloaded yet
2026-03-27 20:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_8ae1d6d09f2355c9252c1c2e0f019629.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_549a082e1d389a89de58b2d7ece7a775.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [auto1.be] INFO: Scrape type for RB98158: 1
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_ea99b986eaf10c006f1c5df938190816.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_ea99b986eaf10c006f1c5df938190816.jpg not downloaded yet
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_f0916c3060770be3adc78c9a8b02322a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_f0916c3060770be3adc78c9a8b02322a.jpg not downloaded yet
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_551df90ce0a96d695890b3fafaaec5f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_551df90ce0a96d695890b3fafaaec5f2.jpg not downloaded yet
2026-03-27 20:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c973ac7-a09e-52bd-8fbd-08c092062467 with identifier: MF52944
2026-03-27 20:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c973ac7-a09e-52bd-8fbd-08c092062467 with scrape type 1
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c973ac7-a09e-52bd-8fbd-08c092062467
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_6294adf8660be0335f642f224cae48fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_6294adf8660be0335f642f224cae48fc.jpg not downloaded yet
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: XL31605
2026-03-27 20:33:53 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-27 20:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [auto1.be] INFO: Scrape type for KC19835: 1
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_5760f86d91e2d4b2df9b4da2d586089e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_5760f86d91e2d4b2df9b4da2d586089e.jpg not downloaded yet
2026-03-27 20:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_31b369da8eb5d4cb3fb61f69e3687807.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_2f0199c8f8d5bf2b8c38f670a248ab48.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_5658fd1de25f29560797992647b306a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_5658fd1de25f29560797992647b306a7.jpg not downloaded yet
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_c1321fc65ec9776cf43eb50b3225bdb7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_c1321fc65ec9776cf43eb50b3225bdb7.jpg not downloaded yet
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_1be5882c38dbcaccd581474a5868e4cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_1be5882c38dbcaccd581474a5868e4cf.jpg not downloaded yet
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352828790>
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_becb7d49a8e96c764aee9ac053a0ba46.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_becb7d49a8e96c764aee9ac053a0ba46.jpg saved to cache
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7feb9c2c-cc83-5421-930e-834c5bfd5694
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ab44d0>
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_776a1cf1acf707667fa20a12b42aa468.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_776a1cf1acf707667fa20a12b42aa468.jpg saved to cache
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80113859-0d8c-5c0c-b815-c99545b46316
2026-03-27 20:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_8098a60acb6044745b8badb28559a4f9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:54 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [auto1.be] INFO: Scrape type for MZ83142: 2
2026-03-27 20:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142
2026-03-27 20:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8dc67b-4464-57eb-8fee-49e21b2fe627 with scrape type 2
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa8dc67b-4464-57eb-8fee-49e21b2fe627 with scrape type 2
2026-03-27 20:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa8dc67b-4464-57eb-8fee-49e21b2fe627, identifier: MZ83142
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_3846cef9743678ae26bc53439d699ddf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_3846cef9743678ae26bc53439d699ddf.jpg not downloaded yet
2026-03-27 20:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_ae47281368e395fd6736b87d05c26d43.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_44c86109e08dcb5218fd0a8bec15afed.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_44c86109e08dcb5218fd0a8bec15afed.jpg not downloaded yet
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_1d0ed55970a39119075a92f9841af9bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_1d0ed55970a39119075a92f9841af9bf.jpg not downloaded yet
2026-03-27 20:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142
2026-03-27 20:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142
2026-03-27 20:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142 to the API
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:46Z',
 'fuel_type': 'diesel',
 'id': 'fa8dc67b-4464-57eb-8fee-49e21b2fe627',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ83142',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 187766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-17',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [auto1.be] INFO: Saving data for MZ83142: {'auction_closing_time': 1774716286.0, 'created_time': 1773866096.224422, 'last_price_update_time': 1774643634.737537}
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ83142') HTTP/1.1" 204 0
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_ec9e6594ead458e062451e854026973b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_ec9e6594ead458e062451e854026973b.jpg not downloaded yet
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529e0fd0>
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_8ae1d6d09f2355c9252c1c2e0f019629.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_8ae1d6d09f2355c9252c1c2e0f019629.jpg saved to cache
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9117a7d2-6ea7-56b3-863c-fd27deb06dcb
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353690390>
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_549a082e1d389a89de58b2d7ece7a775.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_549a082e1d389a89de58b2d7ece7a775.jpg saved to cache
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80113859-0d8c-5c0c-b815-c99545b46316
2026-03-27 20:33:54 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [auto1.be] INFO: Scrape type for WD81319: 1
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_f3337c7081a99b0e799e5e1f575d773c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_f3337c7081a99b0e799e5e1f575d773c.jpg not downloaded yet
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536958d0>
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_31b369da8eb5d4cb3fb61f69e3687807.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_31b369da8eb5d4cb3fb61f69e3687807.jpg saved to cache
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1dcdfc7-42e3-5f56-a936-9499ab8da017
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35354c090>
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_2f0199c8f8d5bf2b8c38f670a248ab48.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_2f0199c8f8d5bf2b8c38f670a248ab48.jpg saved to cache
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80113859-0d8c-5c0c-b815-c99545b46316
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_9ca1ce3428288f4a48743b199f8f04c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_9ca1ce3428288f4a48743b199f8f04c2.jpg not downloaded yet
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_76d6bdf6e1dbcce9615199902f146dca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_76d6bdf6e1dbcce9615199902f146dca.jpg not downloaded yet
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_240cc4cdbaaa9fd6a84fa72205e4da8a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_240cc4cdbaaa9fd6a84fa72205e4da8a.jpg not downloaded yet
2026-03-27 20:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_551df90ce0a96d695890b3fafaaec5f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:55 [auto1.be] INFO: Found listing with ID: MC08958
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC08958%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [auto1.be] INFO: Scrape type for MC08958: 1
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_9a2e272ae0e52a9dd1c5df1cf3a5e57c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_9a2e272ae0e52a9dd1c5df1cf3a5e57c.jpg not downloaded yet
2026-03-27 20:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY99560> (referer: https://www.auto1.com/v1/car-details-view/NY99560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG61894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a53010>
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_8098a60acb6044745b8badb28559a4f9.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_8098a60acb6044745b8badb28559a4f9.jpg saved to cache
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1dcdfc7-42e3-5f56-a936-9499ab8da017
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353594ad0>
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_ae47281368e395fd6736b87d05c26d43.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_ae47281368e395fd6736b87d05c26d43.jpg saved to cache
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7845b786-ced6-52e0-b98e-ad07e24228e2
2026-03-27 20:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_5760f86d91e2d4b2df9b4da2d586089e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_086595a3629a05f9fb0c2c7eaa8670d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_086595a3629a05f9fb0c2c7eaa8670d5.jpg not downloaded yet
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_aa24636fb85afcb729e098bd007a0244.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_aa24636fb85afcb729e098bd007a0244.jpg not downloaded yet
2026-03-27 20:33:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:55 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [auto1.be] INFO: Scrape type for NU46591: 1
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_18f96e4203edd38ea1856e4ca308edfd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_18f96e4203edd38ea1856e4ca308edfd.jpg not downloaded yet
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_c046ca6237ffb5336e8dec155953056f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_c046ca6237ffb5336e8dec155953056f.jpg not downloaded yet
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353448a90>
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_551df90ce0a96d695890b3fafaaec5f2.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_551df90ce0a96d695890b3fafaaec5f2.jpg saved to cache
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1dcdfc7-42e3-5f56-a936-9499ab8da017
2026-03-27 20:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_6294adf8660be0335f642f224cae48fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:55 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [auto1.be] INFO: Scrape type for LZ48262: 2
2026-03-27 20:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262
2026-03-27 20:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a640e348-1bde-5834-9365-38be7c082299 with scrape type 2
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a640e348-1bde-5834-9365-38be7c082299 with scrape type 2
2026-03-27 20:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a640e348-1bde-5834-9365-38be7c082299, identifier: LZ48262
2026-03-27 20:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK68346> (referer: https://www.auto1.com/v1/car-details-view/RK68346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560
2026-03-27 20:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f75c4c57-ac4b-5311-a0db-e58a108023d4 with scrape type 1
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f75c4c57-ac4b-5311-a0db-e58a108023d4
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_4b13f017634deaacecf29c624b878790.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_4b13f017634deaacecf29c624b878790.jpg not downloaded yet
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_1ba9765c014e706890159b1daf10e4d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_1ba9765c014e706890159b1daf10e4d0.jpg not downloaded yet
2026-03-27 20:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262
2026-03-27 20:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262
2026-03-27 20:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262 to the API
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:58:16Z',
 'fuel_type': 'petrol',
 'id': 'a640e348-1bde-5834-9365-38be7c082299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ48262',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 41785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-14',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech YOU',
 'transmission': 'manual',
 'trim': 'YOU',
 'year': 2024}
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [auto1.be] INFO: Saving data for LZ48262: {'auction_closing_time': 1774717096.0, 'created_time': 1773301711.523556, 'last_price_update_time': 1774643635.787668}
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LZ48262') HTTP/1.1" 204 0
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_d47a68125f754c18fee7620f628f9278.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_d47a68125f754c18fee7620f628f9278.jpg not downloaded yet
2026-03-27 20:33:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_f3337c7081a99b0e799e5e1f575d773c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_76d6bdf6e1dbcce9615199902f146dca.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_9ca1ce3428288f4a48743b199f8f04c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:55 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-27 20:33:55 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [auto1.be] INFO: Scrape type for TY52799: 2
2026-03-27 20:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799
2026-03-27 20:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 381d8655-56fb-5dab-ac63-b55d8beb6d0e with scrape type 2
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 381d8655-56fb-5dab-ac63-b55d8beb6d0e with scrape type 2
2026-03-27 20:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 381d8655-56fb-5dab-ac63-b55d8beb6d0e, identifier: TY52799
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_60ec77282e5b1322f6b874f38205593e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_60ec77282e5b1322f6b874f38205593e.jpg not downloaded yet
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352854b90>
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_5760f86d91e2d4b2df9b4da2d586089e.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_5760f86d91e2d4b2df9b4da2d586089e.jpg saved to cache
2026-03-27 20:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7845b786-ced6-52e0-b98e-ad07e24228e2
2026-03-27 20:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799
2026-03-27 20:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799
2026-03-27 20:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799 to the API
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:50Z',
 'fuel_type': 'diesel',
 'id': '381d8655-56fb-5dab-ac63-b55d8beb6d0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY52799',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 133263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-23',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-27 20:33:56 [auto1.be] INFO: Saving data for TY52799: {'auction_closing_time': 1774716350.0, 'created_time': 1773866650.163275, 'last_price_update_time': 1774643636.347826}
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY52799') HTTP/1.1" 204 0
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_7e7390fc24471f1765429e8b2760e1da.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_7e7390fc24471f1765429e8b2760e1da.jpg not downloaded yet
2026-03-27 20:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX56301/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV55176/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3594de090>
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_6294adf8660be0335f642f224cae48fc.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_6294adf8660be0335f642f224cae48fc.jpg saved to cache
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c973ac7-a09e-52bd-8fbd-08c092062467
2026-03-27 20:33:56 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-27 20:33:56 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-27 20:33:56 [auto1.be] INFO: Scrape type for RA46458: 1
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_ffb5226505df54a7812d973307a3b247.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_ffb5226505df54a7812d973307a3b247.jpg not downloaded yet
2026-03-27 20:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV68544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE66186/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_c046ca6237ffb5336e8dec155953056f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_6d9fb34f4a37aa76afb3b1693fb1ff40.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_6d9fb34f4a37aa76afb3b1693fb1ff40.jpg not downloaded yet
2026-03-27 20:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS20047/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346
2026-03-27 20:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b6344d-cf9f-576b-876a-86d555ceef5c with scrape type 1
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5b6344d-cf9f-576b-876a-86d555ceef5c
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_3f97923458569733e48b0fd28f02dff8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_3f97923458569733e48b0fd28f02dff8.jpg not downloaded yet
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35353b190>
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_f3337c7081a99b0e799e5e1f575d773c.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_f3337c7081a99b0e799e5e1f575d773c.jpg saved to cache
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7845b786-ced6-52e0-b98e-ad07e24228e2
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352856110>
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_76d6bdf6e1dbcce9615199902f146dca.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_76d6bdf6e1dbcce9615199902f146dca.jpg saved to cache
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1dcdfc7-42e3-5f56-a936-9499ab8da017
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534a8f10>
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_9ca1ce3428288f4a48743b199f8f04c2.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_9ca1ce3428288f4a48743b199f8f04c2.jpg saved to cache
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80113859-0d8c-5c0c-b815-c99545b46316
2026-03-27 20:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_240cc4cdbaaa9fd6a84fa72205e4da8a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_4b13f017634deaacecf29c624b878790.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:56 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-27 20:33:56 [auto1.be] INFO: Scrape type for ET79377: 2
2026-03-27 20:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377
2026-03-27 20:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd6f3b38-33fa-5979-8f6c-8461ef873c8f with scrape type 2
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd6f3b38-33fa-5979-8f6c-8461ef873c8f with scrape type 2
2026-03-27 20:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd6f3b38-33fa-5979-8f6c-8461ef873c8f, identifier: ET79377
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_11c1929c66be50daf97d24159e04f24f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_11c1929c66be50daf97d24159e04f24f.jpg not downloaded yet
2026-03-27 20:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_18f96e4203edd38ea1856e4ca308edfd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377
2026-03-27 20:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377
2026-03-27 20:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377 to the API
2026-03-27 20:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:06:11Z',
 'fuel_type': 'diesel',
 'id': 'bd6f3b38-33fa-5979-8f6c-8461ef873c8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET79377',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 170186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-17',
 'seller_name': None,
 'title': 'BMW 4er 430d Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-27 20:33:57 [auto1.be] INFO: Saving data for ET79377: {'auction_closing_time': 1774713971.0, 'created_time': 1773909031.458779, 'last_price_update_time': 1774643637.11308}
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET79377') HTTP/1.1" 204 0
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_e0ab806de72b3315a702e6cd0cb7b396.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_e0ab806de72b3315a702e6cd0cb7b396.jpg not downloaded yet
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_c18e42d35218202ac898bea7701406f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_c18e42d35218202ac898bea7701406f2.jpg not downloaded yet
2026-03-27 20:33:57 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-27 20:33:57 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-27 20:33:57 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-27 20:33:57 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-27 20:33:57 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-27 20:33:57 [auto1.be] INFO: Scrape type for CK14854: 2
2026-03-27 20:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854
2026-03-27 20:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b3182c-01b0-545d-a767-c318b1ff4838 with scrape type 2
2026-03-27 20:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b3182c-01b0-545d-a767-c318b1ff4838 with scrape type 2
2026-03-27 20:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17b3182c-01b0-545d-a767-c318b1ff4838, identifier: CK14854
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_0aeb011fe3bf4f32ce3fecb29e1fff74.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_0aeb011fe3bf4f32ce3fecb29e1fff74.jpg not downloaded yet
2026-03-27 20:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b2a0d0>
2026-03-27 20:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_c046ca6237ffb5336e8dec155953056f.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_c046ca6237ffb5336e8dec155953056f.jpg saved to cache
2026-03-27 20:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c973ac7-a09e-52bd-8fbd-08c092062467
2026-03-27 20:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854
2026-03-27 20:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854
2026-03-27 20:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854 to the API
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:56:05Z',
 'fuel_type': 'petrol',
 'id': '17b3182c-01b0-545d-a767-c318b1ff4838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK14854',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 171817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-27',
 'seller_name': None,
 'title': 'Lancia Ypsilon 0.9 TwinAir Gold',
 'transmission': 'automatic',
 'trim': 'Gold',
 'year': 2014}
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-27 20:33:57 [auto1.be] INFO: Saving data for CK14854: {'auction_closing_time': 1774716965.0, 'created_time': 1773822664.508962, 'last_price_update_time': 1774643637.698298}
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK14854') HTTP/1.1" 204 0
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_e04a8ff03885c0a2278f994a1f8e2132.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_e04a8ff03885c0a2278f994a1f8e2132.jpg not downloaded yet
2026-03-27 20:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_aa24636fb85afcb729e098bd007a0244.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_1ba9765c014e706890159b1daf10e4d0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:57 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-27 20:33:57 [auto1.be] INFO: Found listing with ID: AM57328
2026-03-27 20:33:57 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-27 20:33:57 [auto1.be] INFO: Scrape type for KF59500: 2
2026-03-27 20:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500
2026-03-27 20:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bea136e-72af-57e5-86b2-27a644aa7f11 with scrape type 2
2026-03-27 20:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bea136e-72af-57e5-86b2-27a644aa7f11 with scrape type 2
2026-03-27 20:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bea136e-72af-57e5-86b2-27a644aa7f11, identifier: KF59500
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_10f195b0e0900ffd4b691158e6660671.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_10f195b0e0900ffd4b691158e6660671.jpg not downloaded yet
2026-03-27 20:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529ab190>
2026-03-27 20:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_240cc4cdbaaa9fd6a84fa72205e4da8a.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_240cc4cdbaaa9fd6a84fa72205e4da8a.jpg saved to cache
2026-03-27 20:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c973ac7-a09e-52bd-8fbd-08c092062467
2026-03-27 20:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3528a2b10>
2026-03-27 20:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_4b13f017634deaacecf29c624b878790.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_4b13f017634deaacecf29c624b878790.jpg saved to cache
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f75c4c57-ac4b-5311-a0db-e58a108023d4
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35344b5d0>
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_18f96e4203edd38ea1856e4ca308edfd.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_18f96e4203edd38ea1856e4ca308edfd.jpg saved to cache
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1dcdfc7-42e3-5f56-a936-9499ab8da017
2026-03-27 20:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_086595a3629a05f9fb0c2c7eaa8670d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500
2026-03-27 20:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500
2026-03-27 20:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500 to the API
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:18:48Z',
 'fuel_type': 'petrol',
 'id': '2bea136e-72af-57e5-86b2-27a644aa7f11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF59500',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 53112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-10',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Blue Line',
 'transmission': 'manual',
 'trim': 'Blue Line',
 'year': 2004}
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-27 20:33:58 [auto1.be] INFO: Saving data for KF59500: {'auction_closing_time': 1774714728.0, 'created_time': 1773693306.709372, 'last_price_update_time': 1774643638.349353}
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF59500') HTTP/1.1" 204 0
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_46d407d561b5e90e62485909178f30d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_46d407d561b5e90e62485909178f30d1.jpg not downloaded yet
2026-03-27 20:33:58 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-27 20:33:58 [auto1.be] INFO: Scrape type for DW87206: 1
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_50306ea4e3f42269ec61b2738d3b67f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_50306ea4e3f42269ec61b2738d3b67f0.jpg not downloaded yet
2026-03-27 20:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS49836/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_d47a68125f754c18fee7620f628f9278.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_76337deae11f5d9fb6929c2fa8ed1b6d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_76337deae11f5d9fb6929c2fa8ed1b6d.jpg not downloaded yet
2026-03-27 20:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY69036/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB02418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352841e90>
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_aa24636fb85afcb729e098bd007a0244.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_aa24636fb85afcb729e098bd007a0244.jpg saved to cache
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c973ac7-a09e-52bd-8fbd-08c092062467
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb359811dd0>
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_1ba9765c014e706890159b1daf10e4d0.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_1ba9765c014e706890159b1daf10e4d0.jpg saved to cache
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1dcdfc7-42e3-5f56-a936-9499ab8da017
2026-03-27 20:33:58 [auto1.be] INFO: Found listing with ID: FV08195
2026-03-27 20:33:58 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-27 20:33:58 [auto1.be] INFO: Scrape type for ZR52684: 2
2026-03-27 20:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684
2026-03-27 20:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with scrape type 2
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with scrape type 2
2026-03-27 20:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2dc8113-035f-5801-bd6f-331a4cfc9ff8, identifier: ZR52684
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_98e7d0a5ecb1bef79bb2b227df8569df.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_98e7d0a5ecb1bef79bb2b227df8569df.jpg not downloaded yet
2026-03-27 20:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b19dd0>
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_086595a3629a05f9fb0c2c7eaa8670d5.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_086595a3629a05f9fb0c2c7eaa8670d5.jpg saved to cache
2026-03-27 20:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1dcdfc7-42e3-5f56-a936-9499ab8da017
2026-03-27 20:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_60ec77282e5b1322f6b874f38205593e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_ffb5226505df54a7812d973307a3b247.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684
2026-03-27 20:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684
2026-03-27 20:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684 to the API
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:18:36Z',
 'fuel_type': 'diesel',
 'id': 'd2dc8113-035f-5801-bd6f-331a4cfc9ff8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR52684',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 187137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-23',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Advantage blue 2WD',
 'transmission': 'manual',
 'trim': 'Advantage blue 2WD',
 'year': 2018}
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-27 20:33:59 [auto1.be] INFO: Saving data for ZR52684: {'auction_closing_time': 1774714716.0, 'created_time': 1773866092.316563, 'last_price_update_time': 1774643639.028391}
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR52684') HTTP/1.1" 204 0
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_e81f29398bc22ea8a07fece9c5a21ef9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_e81f29398bc22ea8a07fece9c5a21ef9.jpg not downloaded yet
2026-03-27 20:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_7e7390fc24471f1765429e8b2760e1da.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_e04a8ff03885c0a2278f994a1f8e2132.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:33:59 [auto1.be] INFO: Found listing with ID: PW35881
2026-03-27 20:33:59 [auto1.be] INFO: Found listing with ID: ZG24921
2026-03-27 20:33:59 [auto1.be] INFO: Found listing with ID: GC38550
2026-03-27 20:33:59 [auto1.be] INFO: Found listing with ID: KT14369
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT14369%27 HTTP/1.1" 200 None
2026-03-27 20:33:59 [auto1.be] INFO: Scrape type for KT14369: 2
2026-03-27 20:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 057e92d2-5ffe-5107-89ca-aaa830d78735 with identifier: KT14369
2026-03-27 20:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 057e92d2-5ffe-5107-89ca-aaa830d78735 with scrape type 2
2026-03-27 20:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 057e92d2-5ffe-5107-89ca-aaa830d78735 with scrape type 2
2026-03-27 20:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 057e92d2-5ffe-5107-89ca-aaa830d78735, identifier: KT14369
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_bf2b575fbf6212b6bef763f2a74e1f33.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_bf2b575fbf6212b6bef763f2a74e1f33.jpg not downloaded yet
2026-03-27 20:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 057e92d2-5ffe-5107-89ca-aaa830d78735 with identifier: KT14369
2026-03-27 20:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 057e92d2-5ffe-5107-89ca-aaa830d78735 with identifier: KT14369
2026-03-27 20:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 057e92d2-5ffe-5107-89ca-aaa830d78735 with identifier: KT14369 to the API
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:10Z',
 'fuel_type': 'petrol',
 'id': '057e92d2-5ffe-5107-89ca-aaa830d78735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT14369',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 65744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT14369%27 HTTP/1.1" 200 None
2026-03-27 20:33:59 [auto1.be] INFO: Saving data for KT14369: {'auction_closing_time': 1774713850.0, 'created_time': 1774006262.26552, 'last_price_update_time': 1774643639.442978}
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT14369') HTTP/1.1" 204 0
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_42b8ecd3af84dfa75a7cab31d89a995f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_42b8ecd3af84dfa75a7cab31d89a995f.jpg not downloaded yet
2026-03-27 20:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529b8790>
2026-03-27 20:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_d47a68125f754c18fee7620f628f9278.jpg') HTTP/1.1" 204 0
2026-03-27 20:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_d47a68125f754c18fee7620f628f9278.jpg saved to cache
2026-03-27 20:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c973ac7-a09e-52bd-8fbd-08c092062467
2026-03-27 20:33:59 [auto1.be] INFO: Found listing with ID: TH87974
2026-03-27 20:33:59 [auto1.be] INFO: Found listing with ID: BE30662
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30662%27 HTTP/1.1" 200 None
2026-03-27 20:33:59 [auto1.be] INFO: Scrape type for BE30662: 2
2026-03-27 20:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 174d4637-fd2e-5c15-b72b-cbbb88a368ec with identifier: BE30662
2026-03-27 20:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 174d4637-fd2e-5c15-b72b-cbbb88a368ec with scrape type 2
2026-03-27 20:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 174d4637-fd2e-5c15-b72b-cbbb88a368ec with scrape type 2
2026-03-27 20:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 174d4637-fd2e-5c15-b72b-cbbb88a368ec, identifier: BE30662
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_ad30fac156272f96fc692266848c90cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_ad30fac156272f96fc692266848c90cc.jpg not downloaded yet
2026-03-27 20:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 174d4637-fd2e-5c15-b72b-cbbb88a368ec with identifier: BE30662
2026-03-27 20:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 174d4637-fd2e-5c15-b72b-cbbb88a368ec with identifier: BE30662
2026-03-27 20:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 174d4637-fd2e-5c15-b72b-cbbb88a368ec with identifier: BE30662 to the API
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:46Z',
 'fuel_type': 'petrol',
 'id': '174d4637-fd2e-5c15-b72b-cbbb88a368ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE30662',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 79429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30662%27 HTTP/1.1" 200 None
2026-03-27 20:34:00 [auto1.be] INFO: Saving data for BE30662: {'auction_closing_time': 1774713826.0, 'created_time': 1773909048.677028, 'last_price_update_time': 1774643640.018813}
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BE30662') HTTP/1.1" 204 0
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_655f3e9a720589c27d5533b68b1d9405.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_655f3e9a720589c27d5533b68b1d9405.jpg not downloaded yet
2026-03-27 20:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ70715> (referer: https://www.auto1.com/v1/car-details-view/KZ70715/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU46591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG61894> (referer: https://www.auto1.com/v1/car-details-view/HG61894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA46458/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536e1cd0>
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_60ec77282e5b1322f6b874f38205593e.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_60ec77282e5b1322f6b874f38205593e.jpg saved to cache
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f75c4c57-ac4b-5311-a0db-e58a108023d4
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3594dcdd0>
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_ffb5226505df54a7812d973307a3b247.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_ffb5226505df54a7812d973307a3b247.jpg saved to cache
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f75c4c57-ac4b-5311-a0db-e58a108023d4
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529c3c90>
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_7e7390fc24471f1765429e8b2760e1da.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_7e7390fc24471f1765429e8b2760e1da.jpg saved to cache
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c973ac7-a09e-52bd-8fbd-08c092062467
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353696cd0>
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_e04a8ff03885c0a2278f994a1f8e2132.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_e04a8ff03885c0a2278f994a1f8e2132.jpg saved to cache
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5b6344d-cf9f-576b-876a-86d555ceef5c
2026-03-27 20:34:00 [auto1.be] INFO: Found listing with ID: XL16576
2026-03-27 20:34:00 [auto1.be] INFO: Found listing with ID: DB28782
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB28782%27 HTTP/1.1" 200 None
2026-03-27 20:34:00 [auto1.be] INFO: Scrape type for DB28782: 2
2026-03-27 20:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with identifier: DB28782
2026-03-27 20:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with scrape type 2
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with scrape type 2
2026-03-27 20:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e9bccce-a7df-5fb5-8d37-248a91137ee7, identifier: DB28782
2026-03-27 20:34:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU12218> (referer: https://www.auto1.com/v1/car-details-view/UU12218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with identifier: DB28782
2026-03-27 20:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with identifier: DB28782
2026-03-27 20:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with identifier: DB28782 to the API
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:17Z',
 'fuel_type': 'diesel',
 'id': '2e9bccce-a7df-5fb5-8d37-248a91137ee7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB28782',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 144486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2019}
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB28782%27 HTTP/1.1" 200 None
2026-03-27 20:34:00 [auto1.be] INFO: Saving data for DB28782: {'auction_closing_time': 1774716737.0, 'created_time': 1774006260.753822, 'last_price_update_time': 1774643640.856439}
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB28782') HTTP/1.1" 204 0
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_41d57343f2a592c8455a062ecb583a06.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_41d57343f2a592c8455a062ecb583a06.jpg not downloaded yet
2026-03-27 20:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_10f195b0e0900ffd4b691158e6660671.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:00 [auto1.be] INFO: Found listing with ID: SP13149
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP13149%27 HTTP/1.1" 200 None
2026-03-27 20:34:00 [auto1.be] INFO: Scrape type for SP13149: 2
2026-03-27 20:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 420c7f30-7766-5740-9b01-88bb98009ff9 with identifier: SP13149
2026-03-27 20:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 420c7f30-7766-5740-9b01-88bb98009ff9 with scrape type 2
2026-03-27 20:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 420c7f30-7766-5740-9b01-88bb98009ff9 with scrape type 2
2026-03-27 20:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 420c7f30-7766-5740-9b01-88bb98009ff9, identifier: SP13149
2026-03-27 20:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fadae87-10d9-5979-a07f-3fa305c01304 with identifier: KZ70715
2026-03-27 20:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fadae87-10d9-5979-a07f-3fa305c01304 with scrape type 1
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5fadae87-10d9-5979-a07f-3fa305c01304
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_a5e794ae8163039998b07f5a7c5bb5a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_a5e794ae8163039998b07f5a7c5bb5a2.jpg not downloaded yet
2026-03-27 20:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894
2026-03-27 20:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with scrape type 1
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_376b485fc6c75eeba8067f524c09e997.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_376b485fc6c75eeba8067f524c09e997.jpg not downloaded yet
2026-03-27 20:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 420c7f30-7766-5740-9b01-88bb98009ff9 with identifier: SP13149
2026-03-27 20:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 420c7f30-7766-5740-9b01-88bb98009ff9 with identifier: SP13149
2026-03-27 20:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 420c7f30-7766-5740-9b01-88bb98009ff9 with identifier: SP13149 to the API
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:24Z',
 'fuel_type': 'diesel',
 'id': '420c7f30-7766-5740-9b01-88bb98009ff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP13149',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '4008',
 'odometer': 103505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-21',
 'seller_name': None,
 'title': 'Peugeot 4008 1.6 HDi',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP13149%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [auto1.be] INFO: Saving data for SP13149: {'auction_closing_time': 1774716324.0, 'created_time': 1774002093.667836, 'last_price_update_time': 1774643641.444135}
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SP13149') HTTP/1.1" 204 0
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_ec78b977514830cf3b5131d0f2b73d81.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_ec78b977514830cf3b5131d0f2b73d81.jpg not downloaded yet
2026-03-27 20:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_50306ea4e3f42269ec61b2738d3b67f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_ad30fac156272f96fc692266848c90cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:01 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-27 20:34:01 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [auto1.be] INFO: Scrape type for SV23823: 1
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_379a5642080bca042ad96dbab10460d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_379a5642080bca042ad96dbab10460d0.jpg not downloaded yet
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_bc74701e4d688ee1c341aa0e55c2cdc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_bc74701e4d688ee1c341aa0e55c2cdc4.jpg not downloaded yet
2026-03-27 20:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_0aeb011fe3bf4f32ce3fecb29e1fff74.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_98e7d0a5ecb1bef79bb2b227df8569df.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218
2026-03-27 20:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with scrape type 1
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcf%252Fb8cf44d6b42e7406ae39fdd05dea7628%252Fpa%252FUU12218_70832c459c95cc36ab39151eaa7b2d81.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_70832c459c95cc36ab39151eaa7b2d81.jpg already downloaded
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcf%252Fb8cf44d6b42e7406ae39fdd05dea7628%252Fpa%252FUU12218_3c656cd03a55c23517d328571513a925.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_3c656cd03a55c23517d328571513a925.jpg already downloaded
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcf%252Fb8cf44d6b42e7406ae39fdd05dea7628%252Fpa%252FUU12218_8cf506cf5277cbdfc058f3a37877b364.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_8cf506cf5277cbdfc058f3a37877b364.jpg already downloaded
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcf%252Fb8cf44d6b42e7406ae39fdd05dea7628%252Fpa%252FUU12218_0a7943ab437be8d1e3fcc83c4495a203.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_0a7943ab437be8d1e3fcc83c4495a203.jpg already downloaded
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcf%252Fb8cf44d6b42e7406ae39fdd05dea7628%252Fpa%252FUU12218_59e579d12a65351dbef2a5223651312a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_59e579d12a65351dbef2a5223651312a.jpg already downloaded
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcf%252Fb8cf44d6b42e7406ae39fdd05dea7628%252Fpa%252FUU12218_f5ef8becbf17b306cde4b4e73ec7197b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_f5ef8becbf17b306cde4b4e73ec7197b.jpg already downloaded
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcf%252Fb8cf44d6b42e7406ae39fdd05dea7628%252Fpa%252FUU12218_64b32e309a6e0365e1f55abc27f87e53.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_64b32e309a6e0365e1f55abc27f87e53.jpg already downloaded
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcf%252Fb8cf44d6b42e7406ae39fdd05dea7628%252Fpa%252FUU12218_f500cda51248d11668afe68748340eb2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_f500cda51248d11668afe68748340eb2.jpg already downloaded
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcf%252Fb8cf44d6b42e7406ae39fdd05dea7628%252Fpa%252FUU12218_03c00b0128029088cc70a662bd3a54de.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_03c00b0128029088cc70a662bd3a54de.jpg already downloaded
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcf%252Fb8cf44d6b42e7406ae39fdd05dea7628%252Fpa%252FUU12218_86bfd86a54590518a58e936da9d7ea14.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_86bfd86a54590518a58e936da9d7ea14.jpg already downloaded
2026-03-27 20:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e, identifier: UU12218
2026-03-27 20:34:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529271d0>
2026-03-27 20:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_10f195b0e0900ffd4b691158e6660671.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_10f195b0e0900ffd4b691158e6660671.jpg saved to cache
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f75c4c57-ac4b-5311-a0db-e58a108023d4
2026-03-27 20:34:01 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-27 20:34:01 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-27 20:34:01 [auto1.be] INFO: Found listing with ID: ST31185
2026-03-27 20:34:01 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [auto1.be] INFO: Scrape type for HT96077: 1
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_02c57802765c30b3de3a00f4eb64e9fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_02c57802765c30b3de3a00f4eb64e9fe.jpg not downloaded yet
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_a30e2ba01a2db85f97f6e702819da7d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_a30e2ba01a2db85f97f6e702819da7d8.jpg not downloaded yet
2026-03-27 20:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS20047> (referer: https://www.auto1.com/v1/car-details-view/CS20047/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218
2026-03-27 20:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218
2026-03-27 20:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218 to the API
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UU12218>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:07:43Z',
 'fuel_type': 'diesel',
 'id': 'd2f22d05-cfdf-5018-9cd9-dbfd2cd5585e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU12218',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 192210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_70832c459c95cc36ab39151eaa7b2d81.jpg',
                'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_3c656cd03a55c23517d328571513a925.jpg',
                'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_8cf506cf5277cbdfc058f3a37877b364.jpg',
                'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_0a7943ab437be8d1e3fcc83c4495a203.jpg',
                'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_59e579d12a65351dbef2a5223651312a.jpg',
                'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_f5ef8becbf17b306cde4b4e73ec7197b.jpg',
                'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_64b32e309a6e0365e1f55abc27f87e53.jpg',
                'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_f500cda51248d11668afe68748340eb2.jpg',
                'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_03c00b0128029088cc70a662bd3a54de.jpg',
                'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_86bfd86a54590518a58e936da9d7ea14.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e/d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_70832c459c95cc36ab39151eaa7b2d81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e/d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_3c656cd03a55c23517d328571513a925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e/d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_8cf506cf5277cbdfc058f3a37877b364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e/d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_0a7943ab437be8d1e3fcc83c4495a203.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e/d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_59e579d12a65351dbef2a5223651312a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e/d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_f5ef8becbf17b306cde4b4e73ec7197b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e/d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_64b32e309a6e0365e1f55abc27f87e53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e/d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_f500cda51248d11668afe68748340eb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e/d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_03c00b0128029088cc70a662bd3a54de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e/d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cf/b8cf44d6b42e7406ae39fdd05dea7628/pa/UU12218_86bfd86a54590518a58e936da9d7ea14.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [auto1.be] INFO: Saving data for UU12218: {'created_time': 1774643642.26628, 'last_price_update_time': 1774643642.266292, 'auction_closing_time': 1774714063.0}
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UU12218') HTTP/1.1" 204 0
2026-03-27 20:34:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:02 [auto1.be] INFO: Found listing with ID: WT92928
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_1a2846ddbb66abbcb27aa90d89157f15.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_1a2846ddbb66abbcb27aa90d89157f15.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_b30c7be95cf4a952e268c34033792b82.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_b30c7be95cf4a952e268c34033792b82.jpg not downloaded yet
2026-03-27 20:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW87206/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE66186> (referer: https://www.auto1.com/v1/car-details-view/LE66186/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35288e610>
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_50306ea4e3f42269ec61b2738d3b67f0.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_50306ea4e3f42269ec61b2738d3b67f0.jpg saved to cache
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f75c4c57-ac4b-5311-a0db-e58a108023d4
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353680bd0>
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_ad30fac156272f96fc692266848c90cc.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_ad30fac156272f96fc692266848c90cc.jpg saved to cache
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f75c4c57-ac4b-5311-a0db-e58a108023d4
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b1acd0>
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_0aeb011fe3bf4f32ce3fecb29e1fff74.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_0aeb011fe3bf4f32ce3fecb29e1fff74.jpg saved to cache
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f75c4c57-ac4b-5311-a0db-e58a108023d4
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353681710>
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_98e7d0a5ecb1bef79bb2b227df8569df.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_98e7d0a5ecb1bef79bb2b227df8569df.jpg saved to cache
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f75c4c57-ac4b-5311-a0db-e58a108023d4
2026-03-27 20:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_ec78b977514830cf3b5131d0f2b73d81.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_b06206ef5dc6560fca09d14d45e79709.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_b06206ef5dc6560fca09d14d45e79709.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_38b33ff8ba2738134407025ceb31e19c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_38b33ff8ba2738134407025ceb31e19c.jpg not downloaded yet
2026-03-27 20:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047
2026-03-27 20:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9315727-438e-577e-93ee-c9466ccaf151 with scrape type 1
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b9315727-438e-577e-93ee-c9466ccaf151
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_4e1439d943afc0405b75993b7971bbba.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_4e1439d943afc0405b75993b7971bbba.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_4818432bec633b962f3093ad909f9cf3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_4818432bec633b962f3093ad909f9cf3.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_8d354b8923456a39003eecee477a8cdc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_8d354b8923456a39003eecee477a8cdc.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_225f8678ea01c5ddbb3476de9c23624b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_225f8678ea01c5ddbb3476de9c23624b.jpg not downloaded yet
2026-03-27 20:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186
2026-03-27 20:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc with scrape type 1
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_2b1a1a1fe75f5dd264ca03be8e9bb301.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_2b1a1a1fe75f5dd264ca03be8e9bb301.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_cd10cab98f87366746dcb69333ac081e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_cd10cab98f87366746dcb69333ac081e.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_447fd7c6ea1cf2d251abc5ec1535af65.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_447fd7c6ea1cf2d251abc5ec1535af65.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_97fab3ab4bf0a037fcdf0b19b9b419aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_97fab3ab4bf0a037fcdf0b19b9b419aa.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_492059d6f69feda15ba34e284cf43217.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_492059d6f69feda15ba34e284cf43217.jpg not downloaded yet
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ac40d0>
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_ec78b977514830cf3b5131d0f2b73d81.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_ec78b977514830cf3b5131d0f2b73d81.jpg saved to cache
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5b6344d-cf9f-576b-876a-86d555ceef5c
2026-03-27 20:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_376b485fc6c75eeba8067f524c09e997.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_0a3fcd78440d1972398e29e4848550dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_0a3fcd78440d1972398e29e4848550dd.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_1af557f69fd4aa16cb70d7837e629654.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_1af557f69fd4aa16cb70d7837e629654.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_61453a94f9362a143f633f3c89eb18f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_61453a94f9362a143f633f3c89eb18f6.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_18c859c0aa08641c7a7b3554a73f3707.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_18c859c0aa08641c7a7b3554a73f3707.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_259543353c49799eb10d9c91a3ab39d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_259543353c49799eb10d9c91a3ab39d8.jpg not downloaded yet
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_56164be7daebb6beb017b8ea0a5e93a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_56164be7daebb6beb017b8ea0a5e93a2.jpg not downloaded yet
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_00b66979f71f74d95653bb2da4095193.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_00b66979f71f74d95653bb2da4095193.jpg not downloaded yet
2026-03-27 20:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_b30c7be95cf4a952e268c34033792b82.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_74ee1b9f9a1d17b8b2bea399e80ee40a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_74ee1b9f9a1d17b8b2bea399e80ee40a.jpg not downloaded yet
2026-03-27 20:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB02418> (referer: https://www.auto1.com/v1/car-details-view/DB02418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_bc74701e4d688ee1c341aa0e55c2cdc4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_622c81a8adfec2539943161c53b60cb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_622c81a8adfec2539943161c53b60cb4.jpg not downloaded yet
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_389856efac53971f50410746867d73ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_389856efac53971f50410746867d73ff.jpg not downloaded yet
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_191267e5fa9508c3d3998d1dd3bdca16.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_191267e5fa9508c3d3998d1dd3bdca16.jpg not downloaded yet
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_a02df46533baf345ac6d548d8098a6fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_a02df46533baf345ac6d548d8098a6fb.jpg not downloaded yet
2026-03-27 20:34:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35981efd0>
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_376b485fc6c75eeba8067f524c09e997.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_376b485fc6c75eeba8067f524c09e997.jpg saved to cache
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_1fca4d3c684ac82f241aed4e134b8a0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_1fca4d3c684ac82f241aed4e134b8a0d.jpg not downloaded yet
2026-03-27 20:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS49836> (referer: https://www.auto1.com/v1/car-details-view/HS49836/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35285add0>
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_b30c7be95cf4a952e268c34033792b82.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_b30c7be95cf4a952e268c34033792b82.jpg saved to cache
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1
2026-03-27 20:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_492059d6f69feda15ba34e284cf43217.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_d2eeaae93520c7956bc5cd92196151d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_d2eeaae93520c7956bc5cd92196151d7.jpg not downloaded yet
2026-03-27 20:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV68544> (referer: https://www.auto1.com/v1/car-details-view/BV68544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY69036> (referer: https://www.auto1.com/v1/car-details-view/DY69036/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_a30e2ba01a2db85f97f6e702819da7d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_daf0c1426fbb929f721e7d2c921c9d0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_daf0c1426fbb929f721e7d2c921c9d0e.jpg not downloaded yet
2026-03-27 20:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418
2026-03-27 20:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c41c49b8-0139-5934-9516-e0edf2d68ffc with scrape type 1
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c41c49b8-0139-5934-9516-e0edf2d68ffc
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f4f7456fc7abccbe2cb60e212a0a9%252Fpa%252FDB02418_cf94d90275abda6be1fe6cb01f3c15e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_cf94d90275abda6be1fe6cb01f3c15e3.jpg already downloaded
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f4f7456fc7abccbe2cb60e212a0a9%252Fpa%252FDB02418_46c5fe9ef89c80e9966a7d168edf8d97.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_46c5fe9ef89c80e9966a7d168edf8d97.jpg already downloaded
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f4f7456fc7abccbe2cb60e212a0a9%252Fpa%252FDB02418_4cb8c4275e45717f99e56c5fafeefac5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_4cb8c4275e45717f99e56c5fafeefac5.jpg already downloaded
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f4f7456fc7abccbe2cb60e212a0a9%252Fpa%252FDB02418_5cf2004744d9bcca7adf1d6d2755314c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_5cf2004744d9bcca7adf1d6d2755314c.jpg already downloaded
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f4f7456fc7abccbe2cb60e212a0a9%252Fpa%252FDB02418_67dd7cb3330094e90814d4f0cd8f502e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_67dd7cb3330094e90814d4f0cd8f502e.jpg already downloaded
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f4f7456fc7abccbe2cb60e212a0a9%252Fpa%252FDB02418_df6b0a7a1b8563ff2b3ccae0c086c50d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_df6b0a7a1b8563ff2b3ccae0c086c50d.jpg already downloaded
2026-03-27 20:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c41c49b8-0139-5934-9516-e0edf2d68ffc, identifier: DB02418
2026-03-27 20:34:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536e33d0>
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_bc74701e4d688ee1c341aa0e55c2cdc4.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_bc74701e4d688ee1c341aa0e55c2cdc4.jpg saved to cache
2026-03-27 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1
2026-03-27 20:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418
2026-03-27 20:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418
2026-03-27 20:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418 to the API
2026-03-27 20:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DB02418>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:12:31Z',
 'fuel_type': 'diesel',
 'id': 'c41c49b8-0139-5934-9516-e0edf2d68ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB02418',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 206534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_cf94d90275abda6be1fe6cb01f3c15e3.jpg',
                'https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_46c5fe9ef89c80e9966a7d168edf8d97.jpg',
                'https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_4cb8c4275e45717f99e56c5fafeefac5.jpg',
                'https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_5cf2004744d9bcca7adf1d6d2755314c.jpg',
                'https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_67dd7cb3330094e90814d4f0cd8f502e.jpg',
                'https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_df6b0a7a1b8563ff2b3ccae0c086c50d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c41c49b8-0139-5934-9516-e0edf2d68ffc/c41c49b8-0139-5934-9516-e0edf2d68ffc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_cf94d90275abda6be1fe6cb01f3c15e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c41c49b8-0139-5934-9516-e0edf2d68ffc/c41c49b8-0139-5934-9516-e0edf2d68ffc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_46c5fe9ef89c80e9966a7d168edf8d97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c41c49b8-0139-5934-9516-e0edf2d68ffc/c41c49b8-0139-5934-9516-e0edf2d68ffc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_4cb8c4275e45717f99e56c5fafeefac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c41c49b8-0139-5934-9516-e0edf2d68ffc/c41c49b8-0139-5934-9516-e0edf2d68ffc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_5cf2004744d9bcca7adf1d6d2755314c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c41c49b8-0139-5934-9516-e0edf2d68ffc/c41c49b8-0139-5934-9516-e0edf2d68ffc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_67dd7cb3330094e90814d4f0cd8f502e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c41c49b8-0139-5934-9516-e0edf2d68ffc/c41c49b8-0139-5934-9516-e0edf2d68ffc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f4f7456fc7abccbe2cb60e212a0a9/pa/DB02418_df6b0a7a1b8563ff2b3ccae0c086c50d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2012}
2026-03-27 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-27 20:34:04 [auto1.be] INFO: Saving data for DB02418: {'created_time': 1774643644.93607, 'last_price_update_time': 1774643644.936081, 'auction_closing_time': 1774714351.0}
2026-03-27 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB02418') HTTP/1.1" 204 0
2026-03-27 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_f8b546760762b199f6fe30ff4ab01039.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_f8b546760762b199f6fe30ff4ab01039.jpg not downloaded yet
2026-03-27 20:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_00b66979f71f74d95653bb2da4095193.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA46458> (referer: https://www.auto1.com/v1/car-details-view/RA46458/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836
2026-03-27 20:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f37a60ee-f930-574d-82be-1a702a31b7e5 with scrape type 1
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f37a60ee-f930-574d-82be-1a702a31b7e5
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F19%252Faa1942828b29632c256ce824d7b59726%252Fpa%252FHS49836_e6786570144e9ee209b71951197e7a62.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_e6786570144e9ee209b71951197e7a62.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F19%252Faa1942828b29632c256ce824d7b59726%252Fpa%252FHS49836_9d7bd601df678d1ca652dcdda1a9d8b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_9d7bd601df678d1ca652dcdda1a9d8b3.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F19%252Faa1942828b29632c256ce824d7b59726%252Fpa%252FHS49836_52f4aaa7367a86588e081225c42ed994.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_52f4aaa7367a86588e081225c42ed994.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F19%252Faa1942828b29632c256ce824d7b59726%252Fpa%252FHS49836_9f4fa1a4036539e7ec928e16ddc767f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_9f4fa1a4036539e7ec928e16ddc767f7.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F19%252Faa1942828b29632c256ce824d7b59726%252Fpa%252FHS49836_de82a4599c53671b7f090f6833989cda.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_de82a4599c53671b7f090f6833989cda.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F19%252Faa1942828b29632c256ce824d7b59726%252Fpa%252FHS49836_c35a87eb9e0ea966c47e8c737b39373c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_c35a87eb9e0ea966c47e8c737b39373c.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F19%252Faa1942828b29632c256ce824d7b59726%252Fpa%252FHS49836_f75c279825f99b79784a2090e44c1b40.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_f75c279825f99b79784a2090e44c1b40.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F19%252Faa1942828b29632c256ce824d7b59726%252Fpa%252FHS49836_d42182156dab7e2e7909ce114efd683e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_d42182156dab7e2e7909ce114efd683e.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F19%252Faa1942828b29632c256ce824d7b59726%252Fpa%252FHS49836_e813ae967aac85758b79cbfedb73e706.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_e813ae967aac85758b79cbfedb73e706.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F19%252Faa1942828b29632c256ce824d7b59726%252Fpa%252FHS49836_559768636ded851f5b430bd7d2185215.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_559768636ded851f5b430bd7d2185215.jpg already downloaded
2026-03-27 20:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f37a60ee-f930-574d-82be-1a702a31b7e5, identifier: HS49836
2026-03-27 20:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352af4290>
2026-03-27 20:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_492059d6f69feda15ba34e284cf43217.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_492059d6f69feda15ba34e284cf43217.jpg saved to cache
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc
2026-03-27 20:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30cbaaa3-3760-5e0c-937c-4bfb5c0b35df with identifier: BV68544
2026-03-27 20:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30cbaaa3-3760-5e0c-937c-4bfb5c0b35df with scrape type 1
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30cbaaa3-3760-5e0c-937c-4bfb5c0b35df
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F4c%252Ff24c8a205b991c99ea34bf6666f36028%252Fpa%252FBV68544_820b75a2db6e81f15976f7ef55421357.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_820b75a2db6e81f15976f7ef55421357.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F4c%252Ff24c8a205b991c99ea34bf6666f36028%252Fpa%252FBV68544_8629670b911f266ac6eef785a837c918.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_8629670b911f266ac6eef785a837c918.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F4c%252Ff24c8a205b991c99ea34bf6666f36028%252Fpa%252FBV68544_4e942052e9f534f5880e9d9c528072d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_4e942052e9f534f5880e9d9c528072d0.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F4c%252Ff24c8a205b991c99ea34bf6666f36028%252Fpa%252FBV68544_448b1e28cb0970e48da9fb4bd2994115.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_448b1e28cb0970e48da9fb4bd2994115.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F4c%252Ff24c8a205b991c99ea34bf6666f36028%252Fpa%252FBV68544_67ca3d888683813243225bfd3c0734e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_67ca3d888683813243225bfd3c0734e3.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F4c%252Ff24c8a205b991c99ea34bf6666f36028%252Fpa%252FBV68544_3bff8ed38f9d3c1d2b3069c132db5c07.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_3bff8ed38f9d3c1d2b3069c132db5c07.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F4c%252Ff24c8a205b991c99ea34bf6666f36028%252Fpa%252FBV68544_555dec28630c65308576ad88b2d0cd80.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_555dec28630c65308576ad88b2d0cd80.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F4c%252Ff24c8a205b991c99ea34bf6666f36028%252Fpa%252FBV68544_82167d2fbc98004fd1b7b75a8a598005.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_82167d2fbc98004fd1b7b75a8a598005.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F4c%252Ff24c8a205b991c99ea34bf6666f36028%252Fpa%252FBV68544_77885a9710dd9fd043b028da892897a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_77885a9710dd9fd043b028da892897a2.jpg already downloaded
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F4c%252Ff24c8a205b991c99ea34bf6666f36028%252Fpa%252FBV68544_5e194bc350e4f17ddd7565751e9de73b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_5e194bc350e4f17ddd7565751e9de73b.jpg already downloaded
2026-03-27 20:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30cbaaa3-3760-5e0c-937c-4bfb5c0b35df, identifier: BV68544
2026-03-27 20:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036
2026-03-27 20:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19a411a-5376-51bb-adec-fa5662b5b79f with scrape type 1
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e19a411a-5376-51bb-adec-fa5662b5b79f
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_bb03ccdcf254ba7c8d4e99fa483681e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_bb03ccdcf254ba7c8d4e99fa483681e4.jpg not downloaded yet
2026-03-27 20:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bdb6d0>
2026-03-27 20:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_a30e2ba01a2db85f97f6e702819da7d8.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_a30e2ba01a2db85f97f6e702819da7d8.jpg saved to cache
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1
2026-03-27 20:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_56164be7daebb6beb017b8ea0a5e93a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_b558fc91b547bbf59aadd270f5c4a3f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_b558fc91b547bbf59aadd270f5c4a3f4.jpg not downloaded yet
2026-03-27 20:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU46591> (referer: https://www.auto1.com/v1/car-details-view/NU46591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836
2026-03-27 20:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836
2026-03-27 20:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836 to the API
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HS49836>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:30:35Z',
 'fuel_type': 'petrol',
 'id': 'f37a60ee-f930-574d-82be-1a702a31b7e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS49836',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 92340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_e6786570144e9ee209b71951197e7a62.jpg',
                'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_9d7bd601df678d1ca652dcdda1a9d8b3.jpg',
                'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_52f4aaa7367a86588e081225c42ed994.jpg',
                'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_9f4fa1a4036539e7ec928e16ddc767f7.jpg',
                'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_de82a4599c53671b7f090f6833989cda.jpg',
                'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_c35a87eb9e0ea966c47e8c737b39373c.jpg',
                'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_f75c279825f99b79784a2090e44c1b40.jpg',
                'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_d42182156dab7e2e7909ce114efd683e.jpg',
                'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_e813ae967aac85758b79cbfedb73e706.jpg',
                'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_559768636ded851f5b430bd7d2185215.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37a60ee-f930-574d-82be-1a702a31b7e5/f37a60ee-f930-574d-82be-1a702a31b7e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_e6786570144e9ee209b71951197e7a62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37a60ee-f930-574d-82be-1a702a31b7e5/f37a60ee-f930-574d-82be-1a702a31b7e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_9d7bd601df678d1ca652dcdda1a9d8b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37a60ee-f930-574d-82be-1a702a31b7e5/f37a60ee-f930-574d-82be-1a702a31b7e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_52f4aaa7367a86588e081225c42ed994.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37a60ee-f930-574d-82be-1a702a31b7e5/f37a60ee-f930-574d-82be-1a702a31b7e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_9f4fa1a4036539e7ec928e16ddc767f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37a60ee-f930-574d-82be-1a702a31b7e5/f37a60ee-f930-574d-82be-1a702a31b7e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_de82a4599c53671b7f090f6833989cda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37a60ee-f930-574d-82be-1a702a31b7e5/f37a60ee-f930-574d-82be-1a702a31b7e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_c35a87eb9e0ea966c47e8c737b39373c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37a60ee-f930-574d-82be-1a702a31b7e5/f37a60ee-f930-574d-82be-1a702a31b7e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_f75c279825f99b79784a2090e44c1b40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37a60ee-f930-574d-82be-1a702a31b7e5/f37a60ee-f930-574d-82be-1a702a31b7e5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_d42182156dab7e2e7909ce114efd683e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37a60ee-f930-574d-82be-1a702a31b7e5/f37a60ee-f930-574d-82be-1a702a31b7e5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_e813ae967aac85758b79cbfedb73e706.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37a60ee-f930-574d-82be-1a702a31b7e5/f37a60ee-f930-574d-82be-1a702a31b7e5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/19/aa1942828b29632c256ce824d7b59726/pa/HS49836_559768636ded851f5b430bd7d2185215.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2020}
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [auto1.be] INFO: Saving data for HS49836: {'created_time': 1774643646.037091, 'last_price_update_time': 1774643646.037107, 'auction_closing_time': 1774715435.0}
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS49836') HTTP/1.1" 204 0
2026-03-27 20:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30cbaaa3-3760-5e0c-937c-4bfb5c0b35df with identifier: BV68544
2026-03-27 20:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30cbaaa3-3760-5e0c-937c-4bfb5c0b35df with identifier: BV68544
2026-03-27 20:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30cbaaa3-3760-5e0c-937c-4bfb5c0b35df with identifier: BV68544 to the API
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BV68544>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:42:59Z',
 'fuel_type': 'petrol',
 'id': '30cbaaa3-3760-5e0c-937c-4bfb5c0b35df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV68544',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 35214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_820b75a2db6e81f15976f7ef55421357.jpg',
                'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_8629670b911f266ac6eef785a837c918.jpg',
                'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_4e942052e9f534f5880e9d9c528072d0.jpg',
                'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_448b1e28cb0970e48da9fb4bd2994115.jpg',
                'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_67ca3d888683813243225bfd3c0734e3.jpg',
                'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_3bff8ed38f9d3c1d2b3069c132db5c07.jpg',
                'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_555dec28630c65308576ad88b2d0cd80.jpg',
                'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_82167d2fbc98004fd1b7b75a8a598005.jpg',
                'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_77885a9710dd9fd043b028da892897a2.jpg',
                'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_5e194bc350e4f17ddd7565751e9de73b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cbaaa3-3760-5e0c-937c-4bfb5c0b35df/30cbaaa3-3760-5e0c-937c-4bfb5c0b35df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_820b75a2db6e81f15976f7ef55421357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cbaaa3-3760-5e0c-937c-4bfb5c0b35df/30cbaaa3-3760-5e0c-937c-4bfb5c0b35df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_8629670b911f266ac6eef785a837c918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cbaaa3-3760-5e0c-937c-4bfb5c0b35df/30cbaaa3-3760-5e0c-937c-4bfb5c0b35df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_4e942052e9f534f5880e9d9c528072d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cbaaa3-3760-5e0c-937c-4bfb5c0b35df/30cbaaa3-3760-5e0c-937c-4bfb5c0b35df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_448b1e28cb0970e48da9fb4bd2994115.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cbaaa3-3760-5e0c-937c-4bfb5c0b35df/30cbaaa3-3760-5e0c-937c-4bfb5c0b35df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_67ca3d888683813243225bfd3c0734e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cbaaa3-3760-5e0c-937c-4bfb5c0b35df/30cbaaa3-3760-5e0c-937c-4bfb5c0b35df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_3bff8ed38f9d3c1d2b3069c132db5c07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cbaaa3-3760-5e0c-937c-4bfb5c0b35df/30cbaaa3-3760-5e0c-937c-4bfb5c0b35df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_555dec28630c65308576ad88b2d0cd80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cbaaa3-3760-5e0c-937c-4bfb5c0b35df/30cbaaa3-3760-5e0c-937c-4bfb5c0b35df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_82167d2fbc98004fd1b7b75a8a598005.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cbaaa3-3760-5e0c-937c-4bfb5c0b35df/30cbaaa3-3760-5e0c-937c-4bfb5c0b35df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_77885a9710dd9fd043b028da892897a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cbaaa3-3760-5e0c-937c-4bfb5c0b35df/30cbaaa3-3760-5e0c-937c-4bfb5c0b35df_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/4c/f24c8a205b991c99ea34bf6666f36028/pa/BV68544_5e194bc350e4f17ddd7565751e9de73b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen DS3 1.2 VTi Chic',
 'transmission': 'manual',
 'trim': 'Chic',
 'year': 2015}
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV68544%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [auto1.be] INFO: Saving data for BV68544: {'created_time': 1774643646.346217, 'last_price_update_time': 1774643646.346227, 'auction_closing_time': 1774716179.0}
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV68544') HTTP/1.1" 204 0
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_db7822274156484029e352fe096347be.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_db7822274156484029e352fe096347be.jpg not downloaded yet
2026-03-27 20:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353464d90>
2026-03-27 20:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_00b66979f71f74d95653bb2da4095193.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_00b66979f71f74d95653bb2da4095193.jpg saved to cache
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9315727-438e-577e-93ee-c9466ccaf151
2026-03-27 20:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458
2026-03-27 20:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f290f3-de57-56c0-9027-f8b5471ec80e with scrape type 1
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b7f290f3-de57-56c0-9027-f8b5471ec80e
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b3c36a4a1b008eb72e5afdba2f2cc%252Fpa%252FRA46458_d5a0c68bfbec3f9e5ef302915a21229a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_d5a0c68bfbec3f9e5ef302915a21229a.jpg already downloaded
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b3c36a4a1b008eb72e5afdba2f2cc%252Fpa%252FRA46458_e667a445922494147ab74343c7f7e86f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_e667a445922494147ab74343c7f7e86f.jpg already downloaded
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b3c36a4a1b008eb72e5afdba2f2cc%252Fpa%252FRA46458_631d29a8dd678ce2c456a26081591339.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_631d29a8dd678ce2c456a26081591339.jpg already downloaded
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b3c36a4a1b008eb72e5afdba2f2cc%252Fpa%252FRA46458_2f702d4f38f223a291c5dd23246535d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_2f702d4f38f223a291c5dd23246535d8.jpg already downloaded
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b3c36a4a1b008eb72e5afdba2f2cc%252Fpa%252FRA46458_fdd7b3b00ec67fe9340f132c89cd5525.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_fdd7b3b00ec67fe9340f132c89cd5525.jpg already downloaded
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b3c36a4a1b008eb72e5afdba2f2cc%252Fpa%252FRA46458_13d80eab53321081a4134d8ac016f467.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_13d80eab53321081a4134d8ac016f467.jpg already downloaded
2026-03-27 20:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7f290f3-de57-56c0-9027-f8b5471ec80e, identifier: RA46458
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_2bbea4f996c450c9e51201183eac75c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_2bbea4f996c450c9e51201183eac75c7.jpg not downloaded yet
2026-03-27 20:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458
2026-03-27 20:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458
2026-03-27 20:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458 to the API
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA46458>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:53:20Z',
 'fuel_type': 'petrol',
 'id': 'b7f290f3-de57-56c0-9027-f8b5471ec80e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA46458',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 85225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_d5a0c68bfbec3f9e5ef302915a21229a.jpg',
                'https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_e667a445922494147ab74343c7f7e86f.jpg',
                'https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_631d29a8dd678ce2c456a26081591339.jpg',
                'https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_2f702d4f38f223a291c5dd23246535d8.jpg',
                'https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_fdd7b3b00ec67fe9340f132c89cd5525.jpg',
                'https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_13d80eab53321081a4134d8ac016f467.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f290f3-de57-56c0-9027-f8b5471ec80e/b7f290f3-de57-56c0-9027-f8b5471ec80e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_d5a0c68bfbec3f9e5ef302915a21229a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f290f3-de57-56c0-9027-f8b5471ec80e/b7f290f3-de57-56c0-9027-f8b5471ec80e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_e667a445922494147ab74343c7f7e86f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f290f3-de57-56c0-9027-f8b5471ec80e/b7f290f3-de57-56c0-9027-f8b5471ec80e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_631d29a8dd678ce2c456a26081591339.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f290f3-de57-56c0-9027-f8b5471ec80e/b7f290f3-de57-56c0-9027-f8b5471ec80e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_2f702d4f38f223a291c5dd23246535d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f290f3-de57-56c0-9027-f8b5471ec80e/b7f290f3-de57-56c0-9027-f8b5471ec80e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_fdd7b3b00ec67fe9340f132c89cd5525.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f290f3-de57-56c0-9027-f8b5471ec80e/b7f290f3-de57-56c0-9027-f8b5471ec80e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b3c36a4a1b008eb72e5afdba2f2cc/pa/RA46458_13d80eab53321081a4134d8ac016f467.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2000}
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [auto1.be] INFO: Saving data for RA46458: {'created_time': 1774643646.887681, 'last_price_update_time': 1774643646.887693, 'auction_closing_time': 1774716800.0}
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA46458') HTTP/1.1" 204 0
2026-03-27 20:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_76337deae11f5d9fb6929c2fa8ed1b6d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:06 [scrapy.extensions.logstats] INFO: Crawled 208 pages (at 92 pages/min), scraped 299 items (at 60 items/min)
2026-03-27 20:34:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 197MiB
2026-03-27 20:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35354e950>
2026-03-27 20:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_56164be7daebb6beb017b8ea0a5e93a2.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_56164be7daebb6beb017b8ea0a5e93a2.jpg saved to cache
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1
2026-03-27 20:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591
2026-03-27 20:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 985a2368-356f-5991-b43b-36c54861b5b5 with scrape type 1
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 985a2368-356f-5991-b43b-36c54861b5b5
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F97%252F9597f706e8ea6e4b051f856c14756760%252Fpa%252FNU46591_80f5ba25806cd78933b21d5bf15bdaf2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_80f5ba25806cd78933b21d5bf15bdaf2.jpg already downloaded
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F97%252F9597f706e8ea6e4b051f856c14756760%252Fpa%252FNU46591_596b8bcac97d87a85630e5595f5d30a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_596b8bcac97d87a85630e5595f5d30a7.jpg already downloaded
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F97%252F9597f706e8ea6e4b051f856c14756760%252Fpa%252FNU46591_2c6380c156bf2d8f582290c1e474bc9c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_2c6380c156bf2d8f582290c1e474bc9c.jpg already downloaded
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F97%252F9597f706e8ea6e4b051f856c14756760%252Fpa%252FNU46591_a0eb3fa3bb88f18eccc1b02474a754ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_a0eb3fa3bb88f18eccc1b02474a754ab.jpg already downloaded
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F97%252F9597f706e8ea6e4b051f856c14756760%252Fpa%252FNU46591_416cb7739c4966ec9be2d24b3149b261.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_416cb7739c4966ec9be2d24b3149b261.jpg already downloaded
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F97%252F9597f706e8ea6e4b051f856c14756760%252Fpa%252FNU46591_6e25a4ad815c76ab83251ce53ce78e1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_6e25a4ad815c76ab83251ce53ce78e1e.jpg already downloaded
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F97%252F9597f706e8ea6e4b051f856c14756760%252Fpa%252FNU46591_1ed315a7e1033a58784a151c8fbfc51c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_1ed315a7e1033a58784a151c8fbfc51c.jpg already downloaded
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F97%252F9597f706e8ea6e4b051f856c14756760%252Fpa%252FNU46591_74a75e536237b8204e90f37c562769ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_74a75e536237b8204e90f37c562769ff.jpg already downloaded
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F97%252F9597f706e8ea6e4b051f856c14756760%252Fpa%252FNU46591_b0ead7542d02a1c539fc398e5e2c2ed8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_b0ead7542d02a1c539fc398e5e2c2ed8.jpg already downloaded
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F97%252F9597f706e8ea6e4b051f856c14756760%252Fpa%252FNU46591_0300e2dabcbc08a417f26f801503477f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_0300e2dabcbc08a417f26f801503477f.jpg already downloaded
2026-03-27 20:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 985a2368-356f-5991-b43b-36c54861b5b5, identifier: NU46591
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_1fca4d3c684ac82f241aed4e134b8a0d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_d46a523ddc598d229b7bf599a6482c95.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_d46a523ddc598d229b7bf599a6482c95.jpg not downloaded yet
2026-03-27 20:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591
2026-03-27 20:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591
2026-03-27 20:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591 to the API
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NU46591>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '4.4L',
 'engine_horse_power': 530,
 'expiration_date': '2026-03-28T16:45:39Z',
 'fuel_type': 'petrol',
 'id': '985a2368-356f-5991-b43b-36c54861b5b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU46591',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': 'X7',
 'odometer': 82957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_80f5ba25806cd78933b21d5bf15bdaf2.jpg',
                'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_596b8bcac97d87a85630e5595f5d30a7.jpg',
                'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_2c6380c156bf2d8f582290c1e474bc9c.jpg',
                'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_a0eb3fa3bb88f18eccc1b02474a754ab.jpg',
                'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_416cb7739c4966ec9be2d24b3149b261.jpg',
                'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_6e25a4ad815c76ab83251ce53ce78e1e.jpg',
                'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_1ed315a7e1033a58784a151c8fbfc51c.jpg',
                'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_74a75e536237b8204e90f37c562769ff.jpg',
                'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_b0ead7542d02a1c539fc398e5e2c2ed8.jpg',
                'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_0300e2dabcbc08a417f26f801503477f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985a2368-356f-5991-b43b-36c54861b5b5/985a2368-356f-5991-b43b-36c54861b5b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_80f5ba25806cd78933b21d5bf15bdaf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985a2368-356f-5991-b43b-36c54861b5b5/985a2368-356f-5991-b43b-36c54861b5b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_596b8bcac97d87a85630e5595f5d30a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985a2368-356f-5991-b43b-36c54861b5b5/985a2368-356f-5991-b43b-36c54861b5b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_2c6380c156bf2d8f582290c1e474bc9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985a2368-356f-5991-b43b-36c54861b5b5/985a2368-356f-5991-b43b-36c54861b5b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_a0eb3fa3bb88f18eccc1b02474a754ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985a2368-356f-5991-b43b-36c54861b5b5/985a2368-356f-5991-b43b-36c54861b5b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2675252,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_416cb7739c4966ec9be2d24b3149b261.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985a2368-356f-5991-b43b-36c54861b5b5/985a2368-356f-5991-b43b-36c54861b5b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2325155,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_6e25a4ad815c76ab83251ce53ce78e1e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985a2368-356f-5991-b43b-36c54861b5b5/985a2368-356f-5991-b43b-36c54861b5b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2379130,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_1ed315a7e1033a58784a151c8fbfc51c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985a2368-356f-5991-b43b-36c54861b5b5/985a2368-356f-5991-b43b-36c54861b5b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_74a75e536237b8204e90f37c562769ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985a2368-356f-5991-b43b-36c54861b5b5/985a2368-356f-5991-b43b-36c54861b5b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655429,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_b0ead7542d02a1c539fc398e5e2c2ed8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985a2368-356f-5991-b43b-36c54861b5b5/985a2368-356f-5991-b43b-36c54861b5b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/97/9597f706e8ea6e4b051f856c14756760/pa/NU46591_0300e2dabcbc08a417f26f801503477f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'BMW X7 M50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [auto1.be] INFO: Saving data for NU46591: {'created_time': 1774643647.550374, 'last_price_update_time': 1774643647.550384, 'auction_closing_time': 1774716339.0}
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NU46591') HTTP/1.1" 204 0
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_f8263eab64c3033c411b4ec1e73fbb34.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_f8263eab64c3033c411b4ec1e73fbb34.jpg not downloaded yet
2026-03-27 20:34:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352884f50>
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_76337deae11f5d9fb6929c2fa8ed1b6d.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_76337deae11f5d9fb6929c2fa8ed1b6d.jpg saved to cache
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5b6344d-cf9f-576b-876a-86d555ceef5c
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_3f97923458569733e48b0fd28f02dff8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_a02df46533baf345ac6d548d8098a6fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_e084cc2777a5c7860f711de6c1c93735.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_e084cc2777a5c7860f711de6c1c93735.jpg not downloaded yet
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352886250>
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_1fca4d3c684ac82f241aed4e134b8a0d.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_1fca4d3c684ac82f241aed4e134b8a0d.jpg saved to cache
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_d2eeaae93520c7956bc5cd92196151d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_46d407d561b5e90e62485909178f30d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_42b8ecd3af84dfa75a7cab31d89a995f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_655f3e9a720589c27d5533b68b1d9405.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_1a2846ddbb66abbcb27aa90d89157f15.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_259543353c49799eb10d9c91a3ab39d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352937ed0>
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_3f97923458569733e48b0fd28f02dff8.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_3f97923458569733e48b0fd28f02dff8.jpg saved to cache
2026-03-27 20:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5b6344d-cf9f-576b-876a-86d555ceef5c
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_191267e5fa9508c3d3998d1dd3bdca16.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_bb03ccdcf254ba7c8d4e99fa483681e4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_db7822274156484029e352fe096347be.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_f8b546760762b199f6fe30ff4ab01039.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_2bbea4f996c450c9e51201183eac75c7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35290ab10>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_a02df46533baf345ac6d548d8098a6fb.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_a02df46533baf345ac6d548d8098a6fb.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352897c50>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_d2eeaae93520c7956bc5cd92196151d7.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_d2eeaae93520c7956bc5cd92196151d7.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc
2026-03-27 20:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529a9210>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_46d407d561b5e90e62485909178f30d1.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_46d407d561b5e90e62485909178f30d1.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5b6344d-cf9f-576b-876a-86d555ceef5c
2026-03-27 20:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352886410>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_42b8ecd3af84dfa75a7cab31d89a995f.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_42b8ecd3af84dfa75a7cab31d89a995f.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5b6344d-cf9f-576b-876a-86d555ceef5c
2026-03-27 20:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b3fad0>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_655f3e9a720589c27d5533b68b1d9405.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_655f3e9a720589c27d5533b68b1d9405.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5b6344d-cf9f-576b-876a-86d555ceef5c
2026-03-27 20:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534b3f90>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_1a2846ddbb66abbcb27aa90d89157f15.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_1a2846ddbb66abbcb27aa90d89157f15.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5fadae87-10d9-5979-a07f-3fa305c01304
2026-03-27 20:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529b4090>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_259543353c49799eb10d9c91a3ab39d8.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_259543353c49799eb10d9c91a3ab39d8.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5fadae87-10d9-5979-a07f-3fa305c01304
2026-03-27 20:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_daf0c1426fbb929f721e7d2c921c9d0e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_d46a523ddc598d229b7bf599a6482c95.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_b558fc91b547bbf59aadd270f5c4a3f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_f8263eab64c3033c411b4ec1e73fbb34.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_389856efac53971f50410746867d73ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352894350>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_191267e5fa9508c3d3998d1dd3bdca16.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_191267e5fa9508c3d3998d1dd3bdca16.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9315727-438e-577e-93ee-c9466ccaf151
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353465450>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_bb03ccdcf254ba7c8d4e99fa483681e4.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_bb03ccdcf254ba7c8d4e99fa483681e4.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e19a411a-5376-51bb-adec-fa5662b5b79f
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352859890>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_db7822274156484029e352fe096347be.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_db7822274156484029e352fe096347be.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e19a411a-5376-51bb-adec-fa5662b5b79f
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35346a250>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_f8b546760762b199f6fe30ff4ab01039.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_f8b546760762b199f6fe30ff4ab01039.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a2b290>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_2bbea4f996c450c9e51201183eac75c7.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_2bbea4f996c450c9e51201183eac75c7.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e19a411a-5376-51bb-adec-fa5662b5b79f
2026-03-27 20:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_61453a94f9362a143f633f3c89eb18f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_74ee1b9f9a1d17b8b2bea399e80ee40a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_e084cc2777a5c7860f711de6c1c93735.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_18c859c0aa08641c7a7b3554a73f3707.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529998d0>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_daf0c1426fbb929f721e7d2c921c9d0e.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_daf0c1426fbb929f721e7d2c921c9d0e.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a28e50>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_d46a523ddc598d229b7bf599a6482c95.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_d46a523ddc598d229b7bf599a6482c95.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e19a411a-5376-51bb-adec-fa5662b5b79f
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35299b790>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_b558fc91b547bbf59aadd270f5c4a3f4.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_b558fc91b547bbf59aadd270f5c4a3f4.jpg saved to cache
2026-03-27 20:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3528a78d0>
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_f8263eab64c3033c411b4ec1e73fbb34.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_f8263eab64c3033c411b4ec1e73fbb34.jpg saved to cache
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e19a411a-5376-51bb-adec-fa5662b5b79f
2026-03-27 20:34:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352840350>
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_389856efac53971f50410746867d73ff.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_389856efac53971f50410746867d73ff.jpg saved to cache
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1
2026-03-27 20:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_97fab3ab4bf0a037fcdf0b19b9b419aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_1af557f69fd4aa16cb70d7837e629654.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352922e90>
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_61453a94f9362a143f633f3c89eb18f6.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_61453a94f9362a143f633f3c89eb18f6.jpg saved to cache
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9315727-438e-577e-93ee-c9466ccaf151
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35348f290>
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_74ee1b9f9a1d17b8b2bea399e80ee40a.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_74ee1b9f9a1d17b8b2bea399e80ee40a.jpg saved to cache
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b5ee50>
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F0b%252Fd80b4d5d86a8f447b63fb4fdab64b797%252Fpa%252FDY69036_e084cc2777a5c7860f711de6c1c93735.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_e084cc2777a5c7860f711de6c1c93735.jpg saved to cache
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e19a411a-5376-51bb-adec-fa5662b5b79f
2026-03-27 20:34:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e19a411a-5376-51bb-adec-fa5662b5b79f, skipping ID generation
2026-03-27 20:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19a411a-5376-51bb-adec-fa5662b5b79f with scrape type 1
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e19a411a-5376-51bb-adec-fa5662b5b79f sending to next pipeline
2026-03-27 20:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e19a411a-5376-51bb-adec-fa5662b5b79f, identifier: DY69036
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352adfa90>
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_18c859c0aa08641c7a7b3554a73f3707.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_18c859c0aa08641c7a7b3554a73f3707.jpg saved to cache
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc
2026-03-27 20:34:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036
2026-03-27 20:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036
2026-03-27 20:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036 to the API
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_e084cc2777a5c7860f711de6c1c93735.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:48:14Z',
 'fuel_type': 'diesel',
 'id': 'e19a411a-5376-51bb-adec-fa5662b5b79f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY69036',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 188759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_bb03ccdcf254ba7c8d4e99fa483681e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_db7822274156484029e352fe096347be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_2bbea4f996c450c9e51201183eac75c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_d46a523ddc598d229b7bf599a6482c95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_f8263eab64c3033c411b4ec1e73fbb34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19a411a-5376-51bb-adec-fa5662b5b79f/e19a411a-5376-51bb-adec-fa5662b5b79f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/0b/d80b4d5d86a8f447b63fb4fdab64b797/pa/DY69036_e084cc2777a5c7860f711de6c1c93735.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-08-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2009}
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-27 20:34:09 [auto1.be] INFO: Saving data for DY69036: {'created_time': 1774643649.750288, 'last_price_update_time': 1774643649.750299, 'auction_closing_time': 1774716494.0}
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY69036') HTTP/1.1" 204 0
2026-03-27 20:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_447fd7c6ea1cf2d251abc5ec1535af65.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_225f8678ea01c5ddbb3476de9c23624b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_2b1a1a1fe75f5dd264ca03be8e9bb301.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353468090>
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_97fab3ab4bf0a037fcdf0b19b9b419aa.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_97fab3ab4bf0a037fcdf0b19b9b419aa.jpg saved to cache
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9315727-438e-577e-93ee-c9466ccaf151
2026-03-27 20:34:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a36010>
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_1af557f69fd4aa16cb70d7837e629654.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_1af557f69fd4aa16cb70d7837e629654.jpg saved to cache
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1
2026-03-27 20:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_8d354b8923456a39003eecee477a8cdc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_4e1439d943afc0405b75993b7971bbba.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35295ac10>
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_447fd7c6ea1cf2d251abc5ec1535af65.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_447fd7c6ea1cf2d251abc5ec1535af65.jpg saved to cache
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a587d0>
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_225f8678ea01c5ddbb3476de9c23624b.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_225f8678ea01c5ddbb3476de9c23624b.jpg saved to cache
2026-03-27 20:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9315727-438e-577e-93ee-c9466ccaf151
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529d8f50>
2026-03-27 20:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d793375c5c875d6f2d39ec6a0539508%252Fpa%252FLE66186_2b1a1a1fe75f5dd264ca03be8e9bb301.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_2b1a1a1fe75f5dd264ca03be8e9bb301.jpg saved to cache
2026-03-27 20:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc
2026-03-27 20:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23aa2eef-18fc-549f-9d8d-d4675e7addbc, skipping ID generation
2026-03-27 20:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc with scrape type 1
2026-03-27 20:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc sending to next pipeline
2026-03-27 20:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23aa2eef-18fc-549f-9d8d-d4675e7addbc, identifier: LE66186
2026-03-27 20:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186
2026-03-27 20:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186
2026-03-27 20:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186 to the API
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_2b1a1a1fe75f5dd264ca03be8e9bb301.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:52:09Z',
 'fuel_type': 'diesel',
 'id': '23aa2eef-18fc-549f-9d8d-d4675e7addbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE66186',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 250246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_2b1a1a1fe75f5dd264ca03be8e9bb301.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_492059d6f69feda15ba34e284cf43217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_18c859c0aa08641c7a7b3554a73f3707.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_74ee1b9f9a1d17b8b2bea399e80ee40a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_a02df46533baf345ac6d548d8098a6fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_1fca4d3c684ac82f241aed4e134b8a0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_d2eeaae93520c7956bc5cd92196151d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_daf0c1426fbb929f721e7d2c921c9d0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_f8b546760762b199f6fe30ff4ab01039.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa2eef-18fc-549f-9d8d-d4675e7addbc/23aa2eef-18fc-549f-9d8d-d4675e7addbc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d793375c5c875d6f2d39ec6a0539508/pa/LE66186_b558fc91b547bbf59aadd270f5c4a3f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-27 20:34:10 [auto1.be] INFO: Saving data for LE66186: {'created_time': 1774643650.447888, 'last_price_update_time': 1774643650.447902, 'auction_closing_time': 1774716729.0}
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE66186') HTTP/1.1" 204 0
2026-03-27 20:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_38b33ff8ba2738134407025ceb31e19c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT96077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ad89d0>
2026-03-27 20:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_8d354b8923456a39003eecee477a8cdc.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_8d354b8923456a39003eecee477a8cdc.jpg saved to cache
2026-03-27 20:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1
2026-03-27 20:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ada250>
2026-03-27 20:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F49%252F3a492dac3377e076b3fd68cdc825dd7a%252Fpa%252FCS20047_4e1439d943afc0405b75993b7971bbba.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_4e1439d943afc0405b75993b7971bbba.jpg saved to cache
2026-03-27 20:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9315727-438e-577e-93ee-c9466ccaf151
2026-03-27 20:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9315727-438e-577e-93ee-c9466ccaf151, skipping ID generation
2026-03-27 20:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9315727-438e-577e-93ee-c9466ccaf151 with scrape type 1
2026-03-27 20:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9315727-438e-577e-93ee-c9466ccaf151 sending to next pipeline
2026-03-27 20:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9315727-438e-577e-93ee-c9466ccaf151, identifier: CS20047
2026-03-27 20:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047
2026-03-27 20:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047
2026-03-27 20:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047 to the API
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_4e1439d943afc0405b75993b7971bbba.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:29:45Z',
 'fuel_type': 'diesel',
 'id': 'b9315727-438e-577e-93ee-c9466ccaf151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS20047',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 196118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_4e1439d943afc0405b75993b7971bbba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_225f8678ea01c5ddbb3476de9c23624b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_97fab3ab4bf0a037fcdf0b19b9b419aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_61453a94f9362a143f633f3c89eb18f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_00b66979f71f74d95653bb2da4095193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9315727-438e-577e-93ee-c9466ccaf151/b9315727-438e-577e-93ee-c9466ccaf151_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/49/3a492dac3377e076b3fd68cdc825dd7a/pa/CS20047_191267e5fa9508c3d3998d1dd3bdca16.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [auto1.be] INFO: Saving data for CS20047: {'created_time': 1774643651.067447, 'last_price_update_time': 1774643651.067458, 'auction_closing_time': 1774715385.0}
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS20047') HTTP/1.1" 204 0
2026-03-27 20:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_a5e794ae8163039998b07f5a7c5bb5a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW87206> (referer: https://www.auto1.com/v1/car-details-view/DW87206/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a50510>
2026-03-27 20:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F90%252Fc690ed87e568793b74598d18b6f50529%252Fpa%252FHG61894_38b33ff8ba2738134407025ceb31e19c.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_38b33ff8ba2738134407025ceb31e19c.jpg saved to cache
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1
2026-03-27 20:34:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1, skipping ID generation
2026-03-27 20:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with scrape type 1
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 sending to next pipeline
2026-03-27 20:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1, identifier: HG61894
2026-03-27 20:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894
2026-03-27 20:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894
2026-03-27 20:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894 to the API
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_38b33ff8ba2738134407025ceb31e19c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:34:07Z',
 'fuel_type': 'diesel',
 'id': '92ed346f-bea4-53ac-8a8e-ac9f15ca07c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG61894',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 128355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404455,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_376b485fc6c75eeba8067f524c09e997.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435144,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_bc74701e4d688ee1c341aa0e55c2cdc4.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_a30e2ba01a2db85f97f6e702819da7d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_b30c7be95cf4a952e268c34033792b82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_38b33ff8ba2738134407025ceb31e19c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371998,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_8d354b8923456a39003eecee477a8cdc.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435246,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_447fd7c6ea1cf2d251abc5ec1535af65.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426681,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_1af557f69fd4aa16cb70d7837e629654.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_56164be7daebb6beb017b8ea0a5e93a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92ed346f-bea4-53ac-8a8e-ac9f15ca07c1/92ed346f-bea4-53ac-8a8e-ac9f15ca07c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458728,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/90/c690ed87e568793b74598d18b6f50529/pa/HG61894_389856efac53971f50410746867d73ff.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [auto1.be] INFO: Saving data for HG61894: {'created_time': 1774643651.486528, 'last_price_update_time': 1774643651.486538, 'auction_closing_time': 1774715647.0}
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HG61894') HTTP/1.1" 204 0
2026-03-27 20:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_622c81a8adfec2539943161c53b60cb4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_41d57343f2a592c8455a062ecb583a06.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534a5a10>
2026-03-27 20:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_a5e794ae8163039998b07f5a7c5bb5a2.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_a5e794ae8163039998b07f5a7c5bb5a2.jpg saved to cache
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fadae87-10d9-5979-a07f-3fa305c01304
2026-03-27 20:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206
2026-03-27 20:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 219a16b6-d815-5fa2-9c5a-28a2605538df with scrape type 1
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 219a16b6-d815-5fa2-9c5a-28a2605538df
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fea2929fb58f91bbeeeb09d77fd0eb%252Fpa%252FDW87206_1d3d62aae409c648b2af7c9ae24d5465.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_1d3d62aae409c648b2af7c9ae24d5465.jpg already downloaded
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fea2929fb58f91bbeeeb09d77fd0eb%252Fpa%252FDW87206_bbeba0f373ce19c0fdb138fe079609f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_bbeba0f373ce19c0fdb138fe079609f7.jpg already downloaded
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fea2929fb58f91bbeeeb09d77fd0eb%252Fpa%252FDW87206_6ed68d952ef272352287220e04417c95.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_6ed68d952ef272352287220e04417c95.jpg already downloaded
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fea2929fb58f91bbeeeb09d77fd0eb%252Fpa%252FDW87206_beb2edbebac1c6573036163c2153eaa7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_beb2edbebac1c6573036163c2153eaa7.jpg already downloaded
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fea2929fb58f91bbeeeb09d77fd0eb%252Fpa%252FDW87206_ec7c3fa6d84ab8bb474f4767fe662500.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_ec7c3fa6d84ab8bb474f4767fe662500.jpg already downloaded
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fea2929fb58f91bbeeeb09d77fd0eb%252Fpa%252FDW87206_c374295705614f5a08b01c5932fb9d49.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_c374295705614f5a08b01c5932fb9d49.jpg already downloaded
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fea2929fb58f91bbeeeb09d77fd0eb%252Fpa%252FDW87206_80e5500e48c87515925b79ba5adc5c7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_80e5500e48c87515925b79ba5adc5c7a.jpg already downloaded
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fea2929fb58f91bbeeeb09d77fd0eb%252Fpa%252FDW87206_c3b09a6d37853dd781851b9fe9b8aa7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_c3b09a6d37853dd781851b9fe9b8aa7a.jpg already downloaded
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fea2929fb58f91bbeeeb09d77fd0eb%252Fpa%252FDW87206_f0c7e2657308c909f4ba207cddc7fa34.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_f0c7e2657308c909f4ba207cddc7fa34.jpg already downloaded
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fea2929fb58f91bbeeeb09d77fd0eb%252Fpa%252FDW87206_b76f7a9d8cfdec90a202dbb834def089.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_b76f7a9d8cfdec90a202dbb834def089.jpg already downloaded
2026-03-27 20:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 219a16b6-d815-5fa2-9c5a-28a2605538df, identifier: DW87206
2026-03-27 20:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206
2026-03-27 20:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206
2026-03-27 20:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206 to the API
2026-03-27 20:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DW87206>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:42Z',
 'fuel_type': 'diesel',
 'id': '219a16b6-d815-5fa2-9c5a-28a2605538df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW87206',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '2er',
 'odometer': 169340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_1d3d62aae409c648b2af7c9ae24d5465.jpg',
                'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_bbeba0f373ce19c0fdb138fe079609f7.jpg',
                'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_6ed68d952ef272352287220e04417c95.jpg',
                'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_beb2edbebac1c6573036163c2153eaa7.jpg',
                'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_ec7c3fa6d84ab8bb474f4767fe662500.jpg',
                'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_c374295705614f5a08b01c5932fb9d49.jpg',
                'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_80e5500e48c87515925b79ba5adc5c7a.jpg',
                'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_c3b09a6d37853dd781851b9fe9b8aa7a.jpg',
                'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_f0c7e2657308c909f4ba207cddc7fa34.jpg',
                'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_b76f7a9d8cfdec90a202dbb834def089.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219a16b6-d815-5fa2-9c5a-28a2605538df/219a16b6-d815-5fa2-9c5a-28a2605538df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_1d3d62aae409c648b2af7c9ae24d5465.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219a16b6-d815-5fa2-9c5a-28a2605538df/219a16b6-d815-5fa2-9c5a-28a2605538df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_bbeba0f373ce19c0fdb138fe079609f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219a16b6-d815-5fa2-9c5a-28a2605538df/219a16b6-d815-5fa2-9c5a-28a2605538df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_6ed68d952ef272352287220e04417c95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219a16b6-d815-5fa2-9c5a-28a2605538df/219a16b6-d815-5fa2-9c5a-28a2605538df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_beb2edbebac1c6573036163c2153eaa7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219a16b6-d815-5fa2-9c5a-28a2605538df/219a16b6-d815-5fa2-9c5a-28a2605538df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_ec7c3fa6d84ab8bb474f4767fe662500.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219a16b6-d815-5fa2-9c5a-28a2605538df/219a16b6-d815-5fa2-9c5a-28a2605538df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_c374295705614f5a08b01c5932fb9d49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219a16b6-d815-5fa2-9c5a-28a2605538df/219a16b6-d815-5fa2-9c5a-28a2605538df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_80e5500e48c87515925b79ba5adc5c7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219a16b6-d815-5fa2-9c5a-28a2605538df/219a16b6-d815-5fa2-9c5a-28a2605538df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_c3b09a6d37853dd781851b9fe9b8aa7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219a16b6-d815-5fa2-9c5a-28a2605538df/219a16b6-d815-5fa2-9c5a-28a2605538df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_f0c7e2657308c909f4ba207cddc7fa34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219a16b6-d815-5fa2-9c5a-28a2605538df/219a16b6-d815-5fa2-9c5a-28a2605538df_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fea2929fb58f91bbeeeb09d77fd0eb/pa/DW87206_b76f7a9d8cfdec90a202dbb834def089.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 2er 218d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2017}
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [auto1.be] INFO: Saving data for DW87206: {'created_time': 1774643652.173748, 'last_price_update_time': 1774643652.173757, 'auction_closing_time': 1774716702.0}
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW87206') HTTP/1.1" 204 0
2026-03-27 20:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX56301> (referer: https://www.auto1.com/v1/car-details-view/EX56301/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV55176> (referer: https://www.auto1.com/v1/car-details-view/VV55176/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529b4910>
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_622c81a8adfec2539943161c53b60cb4.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_622c81a8adfec2539943161c53b60cb4.jpg saved to cache
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5fadae87-10d9-5979-a07f-3fa305c01304
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3594e0510>
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_41d57343f2a592c8455a062ecb583a06.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_41d57343f2a592c8455a062ecb583a06.jpg saved to cache
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5b6344d-cf9f-576b-876a-86d555ceef5c
2026-03-27 20:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_e81f29398bc22ea8a07fece9c5a21ef9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_bf2b575fbf6212b6bef763f2a74e1f33.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301
2026-03-27 20:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 055508f5-57f2-543a-a3ef-afee25bf24ad with scrape type 1
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 055508f5-57f2-543a-a3ef-afee25bf24ad
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_c70b7309da4e94b02d874e63fd8485b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_c70b7309da4e94b02d874e63fd8485b7.jpg not downloaded yet
2026-03-27 20:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae with identifier: VV55176
2026-03-27 20:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae with scrape type 1
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_5091682d703b26e7d351d4ef592c9df9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_5091682d703b26e7d351d4ef592c9df9.jpg not downloaded yet
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_97bf1f244bf115216f6b0c0f02f1dae2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_97bf1f244bf115216f6b0c0f02f1dae2.jpg not downloaded yet
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_51b6c95d79aaecdb19a252ae5c6aa3b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_51b6c95d79aaecdb19a252ae5c6aa3b2.jpg not downloaded yet
2026-03-27 20:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_cd10cab98f87366746dcb69333ac081e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_c4210d2b55f2658678e85d57a1c534fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_c4210d2b55f2658678e85d57a1c534fa.jpg not downloaded yet
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_cad657c28821f5bf7bf2bf1760e2263b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_cad657c28821f5bf7bf2bf1760e2263b.jpg not downloaded yet
2026-03-27 20:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_0a3fcd78440d1972398e29e4848550dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_ae36bea936575d170f9530b031a381d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_ae36bea936575d170f9530b031a381d1.jpg not downloaded yet
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_9c4f3f72f27204d990938ace5bd6ca85.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_9c4f3f72f27204d990938ace5bd6ca85.jpg not downloaded yet
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352921190>
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_e81f29398bc22ea8a07fece9c5a21ef9.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_e81f29398bc22ea8a07fece9c5a21ef9.jpg saved to cache
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5b6344d-cf9f-576b-876a-86d555ceef5c
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529613d0>
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_bf2b575fbf6212b6bef763f2a74e1f33.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_bf2b575fbf6212b6bef763f2a74e1f33.jpg saved to cache
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f75c4c57-ac4b-5311-a0db-e58a108023d4
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_83e256298dbd87550816f3ded3cd7085.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_83e256298dbd87550816f3ded3cd7085.jpg not downloaded yet
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_3d45b7de40408d6e886dee9f4a9b899d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_3d45b7de40408d6e886dee9f4a9b899d.jpg not downloaded yet
2026-03-27 20:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_c18e42d35218202ac898bea7701406f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_92b30e4f8b4f351777742e3c33c0a69b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_92b30e4f8b4f351777742e3c33c0a69b.jpg not downloaded yet
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_3f9324160ade08cbf520e8837f17e772.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_3f9324160ade08cbf520e8837f17e772.jpg not downloaded yet
2026-03-27 20:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV23823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_e0ab806de72b3315a702e6cd0cb7b396.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_9a2e272ae0e52a9dd1c5df1cf3a5e57c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_7258787495852066203e36d9741e2fa1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_7258787495852066203e36d9741e2fa1.jpg not downloaded yet
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_730c3733b2a4348e94a32b82638b7e09.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_730c3733b2a4348e94a32b82638b7e09.jpg not downloaded yet
2026-03-27 20:34:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35282b310>
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_cd10cab98f87366746dcb69333ac081e.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_cd10cab98f87366746dcb69333ac081e.jpg saved to cache
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5fadae87-10d9-5979-a07f-3fa305c01304
2026-03-27 20:34:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352961ed0>
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_0a3fcd78440d1972398e29e4848550dd.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_0a3fcd78440d1972398e29e4848550dd.jpg saved to cache
2026-03-27 20:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5fadae87-10d9-5979-a07f-3fa305c01304
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_9559afa75fe663c4e43b75139d48d679.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_9559afa75fe663c4e43b75139d48d679.jpg not downloaded yet
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_62976c97957ef224538bf534b1ca5b57.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_62976c97957ef224538bf534b1ca5b57.jpg not downloaded yet
2026-03-27 20:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_11c1929c66be50daf97d24159e04f24f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_4818432bec633b962f3093ad909f9cf3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_a480474efb631c144a218e8687594fd9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_a480474efb631c144a218e8687594fd9.jpg not downloaded yet
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_6f62dda1e147ab3c6733d5a059791a30.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_6f62dda1e147ab3c6733d5a059791a30.jpg not downloaded yet
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352843b90>
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F55%252F50558d02ab32a803b061c2af48a8397a%252Fpa%252FRK68346_c18e42d35218202ac898bea7701406f2.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_c18e42d35218202ac898bea7701406f2.jpg saved to cache
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5b6344d-cf9f-576b-876a-86d555ceef5c
2026-03-27 20:34:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5b6344d-cf9f-576b-876a-86d555ceef5c, skipping ID generation
2026-03-27 20:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b6344d-cf9f-576b-876a-86d555ceef5c with scrape type 1
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5b6344d-cf9f-576b-876a-86d555ceef5c sending to next pipeline
2026-03-27 20:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5b6344d-cf9f-576b-876a-86d555ceef5c, identifier: RK68346
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352961550>
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_e0ab806de72b3315a702e6cd0cb7b396.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_e0ab806de72b3315a702e6cd0cb7b396.jpg saved to cache
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c973ac7-a09e-52bd-8fbd-08c092062467
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf4b10>
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_9a2e272ae0e52a9dd1c5df1cf3a5e57c.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_9a2e272ae0e52a9dd1c5df1cf3a5e57c.jpg saved to cache
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7845b786-ced6-52e0-b98e-ad07e24228e2
2026-03-27 20:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_51b6c95d79aaecdb19a252ae5c6aa3b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346
2026-03-27 20:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346
2026-03-27 20:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346 to the API
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_c18e42d35218202ac898bea7701406f2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Taxi',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:03Z',
 'fuel_type': 'diesel',
 'id': 'c5b6344d-cf9f-576b-876a-86d555ceef5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK68346',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 330990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3169729,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_3f97923458569733e48b0fd28f02dff8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_c18e42d35218202ac898bea7701406f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_e04a8ff03885c0a2278f994a1f8e2132.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3035556,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_46d407d561b5e90e62485909178f30d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2359662,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_76337deae11f5d9fb6929c2fa8ed1b6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_e81f29398bc22ea8a07fece9c5a21ef9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2819327,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_42b8ecd3af84dfa75a7cab31d89a995f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3189361,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_655f3e9a720589c27d5533b68b1d9405.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_41d57343f2a592c8455a062ecb583a06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b6344d-cf9f-576b-876a-86d555ceef5c/c5b6344d-cf9f-576b-876a-86d555ceef5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/55/50558d02ab32a803b061c2af48a8397a/pa/RK68346_ec78b977514830cf3b5131d0f2b73d81.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-27 20:34:13 [auto1.be] INFO: Saving data for RK68346: {'created_time': 1774643653.653374, 'last_price_update_time': 1774643653.653383, 'auction_closing_time': 1774715223.0}
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK68346') HTTP/1.1" 204 0
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_af58dba64d39a9e105fe849a23cdeacf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_af58dba64d39a9e105fe849a23cdeacf.jpg not downloaded yet
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_9ec7d2e767fb607ae2d1c75a9631418e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_9ec7d2e767fb607ae2d1c75a9631418e.jpg not downloaded yet
2026-03-27 20:34:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_6d9fb34f4a37aa76afb3b1693fb1ff40.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT96077> (referer: https://www.auto1.com/v1/car-details-view/HT96077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC08958/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_b06206ef5dc6560fca09d14d45e79709.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_730c3733b2a4348e94a32b82638b7e09.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD81319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529a2b10>
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F9d%252F899d9caa38ebe37fd63b822f6a8cac2d%252Fpa%252FNY99560_11c1929c66be50daf97d24159e04f24f.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_11c1929c66be50daf97d24159e04f24f.jpg saved to cache
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f75c4c57-ac4b-5311-a0db-e58a108023d4
2026-03-27 20:34:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f75c4c57-ac4b-5311-a0db-e58a108023d4, skipping ID generation
2026-03-27 20:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f75c4c57-ac4b-5311-a0db-e58a108023d4 with scrape type 1
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f75c4c57-ac4b-5311-a0db-e58a108023d4 sending to next pipeline
2026-03-27 20:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f75c4c57-ac4b-5311-a0db-e58a108023d4, identifier: NY99560
2026-03-27 20:34:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35299acd0>
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_4818432bec633b962f3093ad909f9cf3.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_4818432bec633b962f3093ad909f9cf3.jpg saved to cache
2026-03-27 20:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5fadae87-10d9-5979-a07f-3fa305c01304
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352adee10>
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_51b6c95d79aaecdb19a252ae5c6aa3b2.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_51b6c95d79aaecdb19a252ae5c6aa3b2.jpg saved to cache
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_ec9e6594ead458e062451e854026973b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560
2026-03-27 20:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560
2026-03-27 20:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560 to the API
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_11c1929c66be50daf97d24159e04f24f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:51:40Z',
 'fuel_type': 'hybrid',
 'id': 'f75c4c57-ac4b-5311-a0db-e58a108023d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY99560',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 76052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44147,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_4b13f017634deaacecf29c624b878790.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402197,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_60ec77282e5b1322f6b874f38205593e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388055,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_ffb5226505df54a7812d973307a3b247.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393646,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_11c1929c66be50daf97d24159e04f24f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364910,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_0aeb011fe3bf4f32ce3fecb29e1fff74.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382181,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_10f195b0e0900ffd4b691158e6660671.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393769,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_50306ea4e3f42269ec61b2738d3b67f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380956,
             'Height': 1358,
             'OriginUrl': 'https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_98e7d0a5ecb1bef79bb2b227df8569df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364690,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_bf2b575fbf6212b6bef763f2a74e1f33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f75c4c57-ac4b-5311-a0db-e58a108023d4/f75c4c57-ac4b-5311-a0db-e58a108023d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52529,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img89/9d/899d9caa38ebe37fd63b822f6a8cac2d/pa/NY99560_ad30fac156272f96fc692266848c90cc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-27 20:34:14 [auto1.be] INFO: Saving data for NY99560: {'created_time': 1774643654.321706, 'last_price_update_time': 1774643654.321717, 'auction_closing_time': 1774716700.0}
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NY99560') HTTP/1.1" 204 0
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_83e256298dbd87550816f3ded3cd7085.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_92b30e4f8b4f351777742e3c33c0a69b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_3f9324160ade08cbf520e8837f17e772.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35299a990>
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_6d9fb34f4a37aa76afb3b1693fb1ff40.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_6d9fb34f4a37aa76afb3b1693fb1ff40.jpg saved to cache
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c973ac7-a09e-52bd-8fbd-08c092062467
2026-03-27 20:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077
2026-03-27 20:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f6612b-fe3c-5c29-8485-9b21469c7c41 with scrape type 1
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3f6612b-fe3c-5c29-8485-9b21469c7c41
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_45676433498c9c2a1dfe08f327a09699.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_45676433498c9c2a1dfe08f327a09699.jpg not downloaded yet
2026-03-27 20:34:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b1bfd0>
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_b06206ef5dc6560fca09d14d45e79709.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_b06206ef5dc6560fca09d14d45e79709.jpg saved to cache
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5fadae87-10d9-5979-a07f-3fa305c01304
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a6f310>
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_730c3733b2a4348e94a32b82638b7e09.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_730c3733b2a4348e94a32b82638b7e09.jpg saved to cache
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_379a5642080bca042ad96dbab10460d0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_3d45b7de40408d6e886dee9f4a9b899d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352871b90>
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_ec9e6594ead458e062451e854026973b.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_ec9e6594ead458e062451e854026973b.jpg saved to cache
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c973ac7-a09e-52bd-8fbd-08c092062467
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_256946493b9dc61649463a209919fe94.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_256946493b9dc61649463a209919fe94.jpg not downloaded yet
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_62976c97957ef224538bf534b1ca5b57.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353681e90>
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_83e256298dbd87550816f3ded3cd7085.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_83e256298dbd87550816f3ded3cd7085.jpg saved to cache
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 055508f5-57f2-543a-a3ef-afee25bf24ad
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ac6bd0>
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_92b30e4f8b4f351777742e3c33c0a69b.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_92b30e4f8b4f351777742e3c33c0a69b.jpg saved to cache
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 055508f5-57f2-543a-a3ef-afee25bf24ad
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353576390>
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_3f9324160ade08cbf520e8837f17e772.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_3f9324160ade08cbf520e8837f17e772.jpg saved to cache
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_c94ab5ab8140d6f237bc0d8f9f0c79f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_c94ab5ab8140d6f237bc0d8f9f0c79f4.jpg not downloaded yet
2026-03-27 20:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_02c57802765c30b3de3a00f4eb64e9fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_af58dba64d39a9e105fe849a23cdeacf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_6f62dda1e147ab3c6733d5a059791a30.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_9ec7d2e767fb607ae2d1c75a9631418e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_9559afa75fe663c4e43b75139d48d679.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_bde1bd858fd4c5cce218e70f0e92916a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_bde1bd858fd4c5cce218e70f0e92916a.jpg not downloaded yet
2026-03-27 20:34:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3528b2550>
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_379a5642080bca042ad96dbab10460d0.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_379a5642080bca042ad96dbab10460d0.jpg saved to cache
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5fadae87-10d9-5979-a07f-3fa305c01304
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353497650>
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_3d45b7de40408d6e886dee9f4a9b899d.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_3d45b7de40408d6e886dee9f4a9b899d.jpg saved to cache
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352972e90>
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_62976c97957ef224538bf534b1ca5b57.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_62976c97957ef224538bf534b1ca5b57.jpg saved to cache
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_90bd0593ff896b565787dfb1921c4494.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_90bd0593ff896b565787dfb1921c4494.jpg not downloaded yet
2026-03-27 20:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_9c4f3f72f27204d990938ace5bd6ca85.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_cad657c28821f5bf7bf2bf1760e2263b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_c4210d2b55f2658678e85d57a1c534fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_b171e1eaf81c1d10bf4dfb6b5dc4ae77.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_b171e1eaf81c1d10bf4dfb6b5dc4ae77.jpg not downloaded yet
2026-03-27 20:34:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352adf450>
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fdf%252Fa4df9eea02138f680a15ed9e1e2cc19a%252Fpa%252FKZ70715_02c57802765c30b3de3a00f4eb64e9fe.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_02c57802765c30b3de3a00f4eb64e9fe.jpg saved to cache
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5fadae87-10d9-5979-a07f-3fa305c01304
2026-03-27 20:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fadae87-10d9-5979-a07f-3fa305c01304, skipping ID generation
2026-03-27 20:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fadae87-10d9-5979-a07f-3fa305c01304 with scrape type 1
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fadae87-10d9-5979-a07f-3fa305c01304 sending to next pipeline
2026-03-27 20:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5fadae87-10d9-5979-a07f-3fa305c01304, identifier: KZ70715
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534670d0>
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_af58dba64d39a9e105fe849a23cdeacf.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_af58dba64d39a9e105fe849a23cdeacf.jpg saved to cache
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 055508f5-57f2-543a-a3ef-afee25bf24ad
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352971b50>
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_6f62dda1e147ab3c6733d5a059791a30.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_6f62dda1e147ab3c6733d5a059791a30.jpg saved to cache
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35368d210>
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_9ec7d2e767fb607ae2d1c75a9631418e.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_9ec7d2e767fb607ae2d1c75a9631418e.jpg saved to cache
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35298e850>
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_9559afa75fe663c4e43b75139d48d679.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_9559afa75fe663c4e43b75139d48d679.jpg saved to cache
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 055508f5-57f2-543a-a3ef-afee25bf24ad
2026-03-27 20:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5fadae87-10d9-5979-a07f-3fa305c01304 with identifier: KZ70715
2026-03-27 20:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5fadae87-10d9-5979-a07f-3fa305c01304 with identifier: KZ70715
2026-03-27 20:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5fadae87-10d9-5979-a07f-3fa305c01304 with identifier: KZ70715 to the API
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_02c57802765c30b3de3a00f4eb64e9fe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:28:42Z',
 'fuel_type': 'diesel',
 'id': '5fadae87-10d9-5979-a07f-3fa305c01304',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ70715',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 185160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_a5e794ae8163039998b07f5a7c5bb5a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2939990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_379a5642080bca042ad96dbab10460d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3161160,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_02c57802765c30b3de3a00f4eb64e9fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2660449,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_1a2846ddbb66abbcb27aa90d89157f15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2855743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_b06206ef5dc6560fca09d14d45e79709.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2852251,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_4818432bec633b962f3093ad909f9cf3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2455152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_cd10cab98f87366746dcb69333ac081e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2874645,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_0a3fcd78440d1972398e29e4848550dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2811997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_259543353c49799eb10d9c91a3ab39d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fadae87-10d9-5979-a07f-3fa305c01304/5fadae87-10d9-5979-a07f-3fa305c01304_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2409766,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4df9eea02138f680a15ed9e1e2cc19a/pa/KZ70715_622c81a8adfec2539943161c53b60cb4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ultra',
 'transmission': 'manual',
 'trim': 'Ultra',
 'year': 2017}
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ70715%27 HTTP/1.1" 200 None
2026-03-27 20:34:15 [auto1.be] INFO: Saving data for KZ70715: {'created_time': 1774643655.913117, 'last_price_update_time': 1774643655.913126, 'auction_closing_time': 1774715322.0}
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KZ70715') HTTP/1.1" 204 0
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_703985524d86f5c9ef836d3fc8903760.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_703985524d86f5c9ef836d3fc8903760.jpg not downloaded yet
2026-03-27 20:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_97bf1f244bf115216f6b0c0f02f1dae2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_c94ab5ab8140d6f237bc0d8f9f0c79f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_0b4b6b428071dfbe0d1f06f195c9b294.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_0b4b6b428071dfbe0d1f06f195c9b294.jpg not downloaded yet
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b28c90>
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_9c4f3f72f27204d990938ace5bd6ca85.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_9c4f3f72f27204d990938ace5bd6ca85.jpg saved to cache
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352855c90>
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_cad657c28821f5bf7bf2bf1760e2263b.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_cad657c28821f5bf7bf2bf1760e2263b.jpg saved to cache
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35351d850>
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_c4210d2b55f2658678e85d57a1c534fa.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_c4210d2b55f2658678e85d57a1c534fa.jpg saved to cache
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 055508f5-57f2-543a-a3ef-afee25bf24ad
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_d1a28498c00fe5bd90a883d875bf5078.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_d1a28498c00fe5bd90a883d875bf5078.jpg not downloaded yet
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_5091682d703b26e7d351d4ef592c9df9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_d9f4e139f24515cf05a8588925444bea.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_d9f4e139f24515cf05a8588925444bea.jpg not downloaded yet
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35287a710>
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_97bf1f244bf115216f6b0c0f02f1dae2.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_97bf1f244bf115216f6b0c0f02f1dae2.jpg saved to cache
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 055508f5-57f2-543a-a3ef-afee25bf24ad
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35957ab10>
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_c94ab5ab8140d6f237bc0d8f9f0c79f4.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_c94ab5ab8140d6f237bc0d8f9f0c79f4.jpg saved to cache
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3f6612b-fe3c-5c29-8485-9b21469c7c41
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_c70b7309da4e94b02d874e63fd8485b7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529cd750>
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2a%252F7b2a4074c90402b8d7fe45844726553b%252Fpa%252FVV55176_5091682d703b26e7d351d4ef592c9df9.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_5091682d703b26e7d351d4ef592c9df9.jpg saved to cache
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae
2026-03-27 20:34:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae, skipping ID generation
2026-03-27 20:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae with scrape type 1
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae sending to next pipeline
2026-03-27 20:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae, identifier: VV55176
2026-03-27 20:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae with identifier: VV55176
2026-03-27 20:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae with identifier: VV55176
2026-03-27 20:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0fbb0901-5ffd-57ae-83ba-bbd414dc40ae with identifier: VV55176 to the API
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_5091682d703b26e7d351d4ef592c9df9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:49:30Z',
 'fuel_type': 'diesel',
 'id': '0fbb0901-5ffd-57ae-83ba-bbd414dc40ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV55176',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 196105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_5091682d703b26e7d351d4ef592c9df9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_51b6c95d79aaecdb19a252ae5c6aa3b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_cad657c28821f5bf7bf2bf1760e2263b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_9c4f3f72f27204d990938ace5bd6ca85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_3d45b7de40408d6e886dee9f4a9b899d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_3f9324160ade08cbf520e8837f17e772.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_730c3733b2a4348e94a32b82638b7e09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_62976c97957ef224538bf534b1ca5b57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_6f62dda1e147ab3c6733d5a059791a30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fbb0901-5ffd-57ae-83ba-bbd414dc40ae/0fbb0901-5ffd-57ae-83ba-bbd414dc40ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/2a/7b2a4074c90402b8d7fe45844726553b/pa/VV55176_9ec7d2e767fb607ae2d1c75a9631418e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Kasten Comfort',
 'transmission': 'manual',
 'trim': 'Kasten Comfort',
 'year': 2013}
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV55176%27 HTTP/1.1" 200 None
2026-03-27 20:34:16 [auto1.be] INFO: Saving data for VV55176: {'created_time': 1774643656.759867, 'last_price_update_time': 1774643656.759879, 'auction_closing_time': 1774716570.0}
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VV55176') HTTP/1.1" 204 0
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_1d0ed55970a39119075a92f9841af9bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529d3010>
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_c70b7309da4e94b02d874e63fd8485b7.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_c70b7309da4e94b02d874e63fd8485b7.jpg saved to cache
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 055508f5-57f2-543a-a3ef-afee25bf24ad
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_44c86109e08dcb5218fd0a8bec15afed.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC08958> (referer: https://www.auto1.com/v1/car-details-view/MC08958/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD81319> (referer: https://www.auto1.com/v1/car-details-view/WD81319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_7258787495852066203e36d9741e2fa1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_a480474efb631c144a218e8687594fd9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_ae36bea936575d170f9530b031a381d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_bde1bd858fd4c5cce218e70f0e92916a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_256946493b9dc61649463a209919fe94.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_45676433498c9c2a1dfe08f327a09699.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352af4710>
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_1d0ed55970a39119075a92f9841af9bf.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_1d0ed55970a39119075a92f9841af9bf.jpg saved to cache
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1dcdfc7-42e3-5f56-a936-9499ab8da017
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_3846cef9743678ae26bc53439d699ddf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_b171e1eaf81c1d10bf4dfb6b5dc4ae77.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35981c7d0>
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_44c86109e08dcb5218fd0a8bec15afed.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_44c86109e08dcb5218fd0a8bec15afed.jpg saved to cache
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80113859-0d8c-5c0c-b815-c99545b46316
2026-03-27 20:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_703985524d86f5c9ef836d3fc8903760.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b588d62-9de3-5617-9d65-e09ce1b4deb9 with identifier: MC08958
2026-03-27 20:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9 with scrape type 1
2026-03-27 20:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9
2026-03-27 20:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_d965dbabad20549f58683994dda99b48.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_d965dbabad20549f58683994dda99b48.jpg not downloaded yet
2026-03-27 20:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319
2026-03-27 20:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with scrape type 1
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_e9082aaf9f4ee3b7eebbf35daa2eb765.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_e9082aaf9f4ee3b7eebbf35daa2eb765.jpg not downloaded yet
2026-03-27 20:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35287bd90>
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_7258787495852066203e36d9741e2fa1.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_7258787495852066203e36d9741e2fa1.jpg saved to cache
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 055508f5-57f2-543a-a3ef-afee25bf24ad
2026-03-27 20:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b65ed0>
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_a480474efb631c144a218e8687594fd9.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_a480474efb631c144a218e8687594fd9.jpg saved to cache
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 055508f5-57f2-543a-a3ef-afee25bf24ad
2026-03-27 20:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353501610>
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F43%252F39430df26e985eb75278db9b964b51ae%252Fpa%252FEX56301_ae36bea936575d170f9530b031a381d1.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_ae36bea936575d170f9530b031a381d1.jpg saved to cache
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 055508f5-57f2-543a-a3ef-afee25bf24ad
2026-03-27 20:34:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 055508f5-57f2-543a-a3ef-afee25bf24ad, skipping ID generation
2026-03-27 20:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 055508f5-57f2-543a-a3ef-afee25bf24ad with scrape type 1
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 055508f5-57f2-543a-a3ef-afee25bf24ad sending to next pipeline
2026-03-27 20:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 055508f5-57f2-543a-a3ef-afee25bf24ad, identifier: EX56301
2026-03-27 20:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301
2026-03-27 20:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301
2026-03-27 20:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301 to the API
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_ae36bea936575d170f9530b031a381d1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:55:40Z',
 'fuel_type': 'diesel',
 'id': '055508f5-57f2-543a-a3ef-afee25bf24ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX56301',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 134900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_c70b7309da4e94b02d874e63fd8485b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_97bf1f244bf115216f6b0c0f02f1dae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_c4210d2b55f2658678e85d57a1c534fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2714960,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_ae36bea936575d170f9530b031a381d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_83e256298dbd87550816f3ded3cd7085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_92b30e4f8b4f351777742e3c33c0a69b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2572122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_7258787495852066203e36d9741e2fa1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_9559afa75fe663c4e43b75139d48d679.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2547185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_a480474efb631c144a218e8687594fd9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_055508f5-57f2-543a-a3ef-afee25bf24ad/055508f5-57f2-543a-a3ef-afee25bf24ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/43/39430df26e985eb75278db9b964b51ae/pa/EX56301_af58dba64d39a9e105fe849a23cdeacf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S60 2.0 D4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2017}
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-27 20:34:17 [auto1.be] INFO: Saving data for EX56301: {'created_time': 1774643657.861915, 'last_price_update_time': 1774643657.861926, 'auction_closing_time': 1774716940.0}
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX56301') HTTP/1.1" 204 0
2026-03-27 20:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_0b4b6b428071dfbe0d1f06f195c9b294.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_907c6ab1bd64c63c81eb2b69a805ae68.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_907c6ab1bd64c63c81eb2b69a805ae68.jpg not downloaded yet
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_9818858fb7e824127269c3c54bfc4cca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_9818858fb7e824127269c3c54bfc4cca.jpg not downloaded yet
2026-03-27 20:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_5658fd1de25f29560797992647b306a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_c1321fc65ec9776cf43eb50b3225bdb7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bc2a10>
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_bde1bd858fd4c5cce218e70f0e92916a.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_bde1bd858fd4c5cce218e70f0e92916a.jpg saved to cache
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3f6612b-fe3c-5c29-8485-9b21469c7c41
2026-03-27 20:34:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352af7450>
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_256946493b9dc61649463a209919fe94.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_256946493b9dc61649463a209919fe94.jpg saved to cache
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3f6612b-fe3c-5c29-8485-9b21469c7c41
2026-03-27 20:34:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a0ba10>
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_45676433498c9c2a1dfe08f327a09699.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_45676433498c9c2a1dfe08f327a09699.jpg saved to cache
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3f6612b-fe3c-5c29-8485-9b21469c7c41
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352970550>
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_3846cef9743678ae26bc53439d699ddf.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_3846cef9743678ae26bc53439d699ddf.jpg saved to cache
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7845b786-ced6-52e0-b98e-ad07e24228e2
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35290ab10>
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_b171e1eaf81c1d10bf4dfb6b5dc4ae77.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_b171e1eaf81c1d10bf4dfb6b5dc4ae77.jpg saved to cache
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3f6612b-fe3c-5c29-8485-9b21469c7c41
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3598d9a50>
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_703985524d86f5c9ef836d3fc8903760.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_703985524d86f5c9ef836d3fc8903760.jpg saved to cache
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3f6612b-fe3c-5c29-8485-9b21469c7c41
2026-03-27 20:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_1be5882c38dbcaccd581474a5868e4cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_4761a8c534d40b3b5ffeb2b8fbfb8616.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_4761a8c534d40b3b5ffeb2b8fbfb8616.jpg not downloaded yet
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_5a22d269172fe041a0d284e65ebed5a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_5a22d269172fe041a0d284e65ebed5a1.jpg not downloaded yet
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_9ef26c60937bff697cafbb5f6b38c394.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_9ef26c60937bff697cafbb5f6b38c394.jpg not downloaded yet
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_b396b1806d67224b54c9dd29d9d46040.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_b396b1806d67224b54c9dd29d9d46040.jpg not downloaded yet
2026-03-27 20:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV23823> (referer: https://www.auto1.com/v1/car-details-view/SV23823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352840b90>
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_0b4b6b428071dfbe0d1f06f195c9b294.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_0b4b6b428071dfbe0d1f06f195c9b294.jpg saved to cache
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3f6612b-fe3c-5c29-8485-9b21469c7c41
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529e0750>
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_5658fd1de25f29560797992647b306a7.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_5658fd1de25f29560797992647b306a7.jpg saved to cache
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80113859-0d8c-5c0c-b815-c99545b46316
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353579550>
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_c1321fc65ec9776cf43eb50b3225bdb7.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_c1321fc65ec9776cf43eb50b3225bdb7.jpg saved to cache
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1dcdfc7-42e3-5f56-a936-9499ab8da017
2026-03-27 20:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_cd908599eeb15bde6376bfb77847487c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_cd908599eeb15bde6376bfb77847487c.jpg not downloaded yet
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_7f590cd2421bb4a86e7b056abec92470.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_7f590cd2421bb4a86e7b056abec92470.jpg not downloaded yet
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35296b650>
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F94%252Fc994b001ca567984e62dcd541a214da9%252Fpa%252FMF52944_1be5882c38dbcaccd581474a5868e4cf.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_1be5882c38dbcaccd581474a5868e4cf.jpg saved to cache
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c973ac7-a09e-52bd-8fbd-08c092062467
2026-03-27 20:34:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c973ac7-a09e-52bd-8fbd-08c092062467, skipping ID generation
2026-03-27 20:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c973ac7-a09e-52bd-8fbd-08c092062467 with scrape type 1
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c973ac7-a09e-52bd-8fbd-08c092062467 sending to next pipeline
2026-03-27 20:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5c973ac7-a09e-52bd-8fbd-08c092062467, identifier: MF52944
2026-03-27 20:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823
2026-03-27 20:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11bb0ce2-f631-5cbe-8d25-185616472de3 with scrape type 1
2026-03-27 20:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11bb0ce2-f631-5cbe-8d25-185616472de3
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd0%252Fabd08020eae7781441cbfcb957089c4e%252Fpa%252FSV23823_49eb256628e85a2e861757944ccb39a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_49eb256628e85a2e861757944ccb39a8.jpg already downloaded
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd0%252Fabd08020eae7781441cbfcb957089c4e%252Fpa%252FSV23823_f86979bb26a68c21255399a791f0bc85.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_f86979bb26a68c21255399a791f0bc85.jpg already downloaded
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd0%252Fabd08020eae7781441cbfcb957089c4e%252Fpa%252FSV23823_ebe3c54db77ac7debbb24fd97020c7ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_ebe3c54db77ac7debbb24fd97020c7ca.jpg already downloaded
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd0%252Fabd08020eae7781441cbfcb957089c4e%252Fpa%252FSV23823_388059b407e800935f807da51c17fc1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_388059b407e800935f807da51c17fc1b.jpg already downloaded
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd0%252Fabd08020eae7781441cbfcb957089c4e%252Fpa%252FSV23823_0fec427c895d3578aff0e6c426a3bf85.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_0fec427c895d3578aff0e6c426a3bf85.jpg already downloaded
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd0%252Fabd08020eae7781441cbfcb957089c4e%252Fpa%252FSV23823_6dc377170d4c9a61f1dda6ea3ec407bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_6dc377170d4c9a61f1dda6ea3ec407bb.jpg already downloaded
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd0%252Fabd08020eae7781441cbfcb957089c4e%252Fpa%252FSV23823_cb1ff73c6a261709ba1d75fcc60a15aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_cb1ff73c6a261709ba1d75fcc60a15aa.jpg already downloaded
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd0%252Fabd08020eae7781441cbfcb957089c4e%252Fpa%252FSV23823_bd2527686152f2500843a6c5da39f27f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_bd2527686152f2500843a6c5da39f27f.jpg already downloaded
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd0%252Fabd08020eae7781441cbfcb957089c4e%252Fpa%252FSV23823_b98da4553ad03077f15b7bded4fd4a61.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_b98da4553ad03077f15b7bded4fd4a61.jpg already downloaded
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd0%252Fabd08020eae7781441cbfcb957089c4e%252Fpa%252FSV23823_10b6403a02f6041187900a6662980f4d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_10b6403a02f6041187900a6662980f4d.jpg already downloaded
2026-03-27 20:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11bb0ce2-f631-5cbe-8d25-185616472de3, identifier: SV23823
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_7e16b57a935a1b78387031b6e982d826.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_7e16b57a935a1b78387031b6e982d826.jpg not downloaded yet
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_13cd2fb8ea84437df4f598574d0bc76f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_13cd2fb8ea84437df4f598574d0bc76f.jpg not downloaded yet
2026-03-27 20:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5c973ac7-a09e-52bd-8fbd-08c092062467 with identifier: MF52944
2026-03-27 20:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5c973ac7-a09e-52bd-8fbd-08c092062467 with identifier: MF52944
2026-03-27 20:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5c973ac7-a09e-52bd-8fbd-08c092062467 with identifier: MF52944 to the API
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_1be5882c38dbcaccd581474a5868e4cf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:05:18Z',
 'fuel_type': 'diesel',
 'id': '5c973ac7-a09e-52bd-8fbd-08c092062467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF52944',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 119766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368057,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_6294adf8660be0335f642f224cae48fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354683,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_1be5882c38dbcaccd581474a5868e4cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374700,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_ec9e6594ead458e062451e854026973b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331489,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_240cc4cdbaaa9fd6a84fa72205e4da8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_aa24636fb85afcb729e098bd007a0244.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_c046ca6237ffb5336e8dec155953056f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308023,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_d47a68125f754c18fee7620f628f9278.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517821,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_7e7390fc24471f1765429e8b2760e1da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_6d9fb34f4a37aa76afb3b1693fb1ff40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c973ac7-a09e-52bd-8fbd-08c092062467/5c973ac7-a09e-52bd-8fbd-08c092062467_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/94/c994b001ca567984e62dcd541a214da9/pa/MF52944_e0ab806de72b3315a702e6cd0cb7b396.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2011}
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF52944%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [auto1.be] INFO: Saving data for MF52944: {'created_time': 1774643659.637025, 'last_price_update_time': 1774643659.637035, 'auction_closing_time': 1774713918.0}
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MF52944') HTTP/1.1" 204 0
2026-03-27 20:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823
2026-03-27 20:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823
2026-03-27 20:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823 to the API
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SV23823>
{'auction_title': '',
 'c_o_2_emission_value': 228,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6C',
 'engine': '3.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:28:48Z',
 'fuel_type': 'diesel',
 'id': '11bb0ce2-f631-5cbe-8d25-185616472de3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV23823',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 72737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_49eb256628e85a2e861757944ccb39a8.jpg',
                'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_f86979bb26a68c21255399a791f0bc85.jpg',
                'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_ebe3c54db77ac7debbb24fd97020c7ca.jpg',
                'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_388059b407e800935f807da51c17fc1b.jpg',
                'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_0fec427c895d3578aff0e6c426a3bf85.jpg',
                'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_6dc377170d4c9a61f1dda6ea3ec407bb.jpg',
                'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_cb1ff73c6a261709ba1d75fcc60a15aa.jpg',
                'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_bd2527686152f2500843a6c5da39f27f.jpg',
                'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_b98da4553ad03077f15b7bded4fd4a61.jpg',
                'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_10b6403a02f6041187900a6662980f4d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bb0ce2-f631-5cbe-8d25-185616472de3/11bb0ce2-f631-5cbe-8d25-185616472de3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_49eb256628e85a2e861757944ccb39a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bb0ce2-f631-5cbe-8d25-185616472de3/11bb0ce2-f631-5cbe-8d25-185616472de3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_f86979bb26a68c21255399a791f0bc85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bb0ce2-f631-5cbe-8d25-185616472de3/11bb0ce2-f631-5cbe-8d25-185616472de3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_ebe3c54db77ac7debbb24fd97020c7ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bb0ce2-f631-5cbe-8d25-185616472de3/11bb0ce2-f631-5cbe-8d25-185616472de3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_388059b407e800935f807da51c17fc1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bb0ce2-f631-5cbe-8d25-185616472de3/11bb0ce2-f631-5cbe-8d25-185616472de3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_0fec427c895d3578aff0e6c426a3bf85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bb0ce2-f631-5cbe-8d25-185616472de3/11bb0ce2-f631-5cbe-8d25-185616472de3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_6dc377170d4c9a61f1dda6ea3ec407bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bb0ce2-f631-5cbe-8d25-185616472de3/11bb0ce2-f631-5cbe-8d25-185616472de3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_cb1ff73c6a261709ba1d75fcc60a15aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bb0ce2-f631-5cbe-8d25-185616472de3/11bb0ce2-f631-5cbe-8d25-185616472de3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_bd2527686152f2500843a6c5da39f27f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bb0ce2-f631-5cbe-8d25-185616472de3/11bb0ce2-f631-5cbe-8d25-185616472de3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_b98da4553ad03077f15b7bded4fd4a61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bb0ce2-f631-5cbe-8d25-185616472de3/11bb0ce2-f631-5cbe-8d25-185616472de3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d0/abd08020eae7781441cbfcb957089c4e/pa/SV23823_10b6403a02f6041187900a6662980f4d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2017}
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [auto1.be] INFO: Saving data for SV23823: {'created_time': 1774643659.931199, 'last_price_update_time': 1774643659.931209, 'auction_closing_time': 1774715328.0}
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SV23823') HTTP/1.1" 204 0
2026-03-27 20:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_e9082aaf9f4ee3b7eebbf35daa2eb765.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_5a22d269172fe041a0d284e65ebed5a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_4761a8c534d40b3b5ffeb2b8fbfb8616.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_9818858fb7e824127269c3c54bfc4cca.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_acd278ca23a2ae1a8fc463a074460417.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_acd278ca23a2ae1a8fc463a074460417.jpg not downloaded yet
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_3e1109d9813ce98648923b94c3e99bf5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_3e1109d9813ce98648923b94c3e99bf5.jpg not downloaded yet
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_9c544cfb8c0f0c0291eb0a529d6218dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_9c544cfb8c0f0c0291eb0a529d6218dd.jpg not downloaded yet
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_95e7bd0611cf9559587d594c7df50faa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_95e7bd0611cf9559587d594c7df50faa.jpg not downloaded yet
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_51d2d5af50677c568ca6ff9ca66ace6d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_51d2d5af50677c568ca6ff9ca66ace6d.jpg not downloaded yet
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_c2fb363a7316201992794c2f9f8f6f5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_c2fb363a7316201992794c2f9f8f6f5b.jpg not downloaded yet
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_f0916c3060770be3adc78c9a8b02322a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_82cae0a4978c3689d4e740cae72958df.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_82cae0a4978c3689d4e740cae72958df.jpg not downloaded yet
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_741a6e7239fd1173d905a415689cbcfb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_741a6e7239fd1173d905a415689cbcfb.jpg not downloaded yet
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529c2a10>
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_e9082aaf9f4ee3b7eebbf35daa2eb765.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_e9082aaf9f4ee3b7eebbf35daa2eb765.jpg saved to cache
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35298e7d0>
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_5a22d269172fe041a0d284e65ebed5a1.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_5a22d269172fe041a0d284e65ebed5a1.jpg saved to cache
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536c6bd0>
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_4761a8c534d40b3b5ffeb2b8fbfb8616.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_4761a8c534d40b3b5ffeb2b8fbfb8616.jpg saved to cache
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a37c10>
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_9818858fb7e824127269c3c54bfc4cca.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_9818858fb7e824127269c3c54bfc4cca.jpg saved to cache
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_ea99b986eaf10c006f1c5df938190816.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_667469d7aa979fc4525c2e4784d298a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b69250>
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_f0916c3060770be3adc78c9a8b02322a.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_f0916c3060770be3adc78c9a8b02322a.jpg saved to cache
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80113859-0d8c-5c0c-b815-c99545b46316
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_661f9e307782a9d4272c4c654a796c83.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_d1a28498c00fe5bd90a883d875bf5078.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_907c6ab1bd64c63c81eb2b69a805ae68.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_13cd2fb8ea84437df4f598574d0bc76f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_90bd0593ff896b565787dfb1921c4494.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_d9f4e139f24515cf05a8588925444bea.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_d965dbabad20549f58683994dda99b48.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_7f590cd2421bb4a86e7b056abec92470.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529f7b90>
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fbe%252F01beaf32f31b51bf9151f7321fa25824%252Fpa%252FLJ91533_ea99b986eaf10c006f1c5df938190816.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_ea99b986eaf10c006f1c5df938190816.jpg saved to cache
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7845b786-ced6-52e0-b98e-ad07e24228e2
2026-03-27 20:34:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7845b786-ced6-52e0-b98e-ad07e24228e2, skipping ID generation
2026-03-27 20:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7845b786-ced6-52e0-b98e-ad07e24228e2 with scrape type 1
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7845b786-ced6-52e0-b98e-ad07e24228e2 sending to next pipeline
2026-03-27 20:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7845b786-ced6-52e0-b98e-ad07e24228e2, identifier: LJ91533
2026-03-27 20:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533
2026-03-27 20:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533
2026-03-27 20:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533 to the API
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_ea99b986eaf10c006f1c5df938190816.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:45:52Z',
 'fuel_type': 'diesel',
 'id': '7845b786-ced6-52e0-b98e-ad07e24228e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ91533',
 'listing': 'auction',
 'location': 'BE, Messancy',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 249231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_ae47281368e395fd6736b87d05c26d43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_ea99b986eaf10c006f1c5df938190816.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_5760f86d91e2d4b2df9b4da2d586089e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_3846cef9743678ae26bc53439d699ddf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_f3337c7081a99b0e799e5e1f575d773c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7845b786-ced6-52e0-b98e-ad07e24228e2/7845b786-ced6-52e0-b98e-ad07e24228e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/be/01beaf32f31b51bf9151f7321fa25824/pa/LJ91533_9a2e272ae0e52a9dd1c5df1cf3a5e57c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2010}
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-27 20:34:20 [auto1.be] INFO: Saving data for LJ91533: {'created_time': 1774643660.82226, 'last_price_update_time': 1774643660.822273, 'auction_closing_time': 1774716352.0}
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LJ91533') HTTP/1.1" 204 0
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_741a6e7239fd1173d905a415689cbcfb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_c2fb363a7316201992794c2f9f8f6f5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_82cae0a4978c3689d4e740cae72958df.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_7e16b57a935a1b78387031b6e982d826.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB98158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC19835/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3535b5e10>
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fbf%252F4cbf9fe13e5a8366e5721b996a3a6260%252Fpa%252FLF48909_667469d7aa979fc4525c2e4784d298a6.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_667469d7aa979fc4525c2e4784d298a6.jpg saved to cache
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1dcdfc7-42e3-5f56-a936-9499ab8da017
2026-03-27 20:34:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1dcdfc7-42e3-5f56-a936-9499ab8da017, skipping ID generation
2026-03-27 20:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1dcdfc7-42e3-5f56-a936-9499ab8da017 with scrape type 1
2026-03-27 20:34:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1dcdfc7-42e3-5f56-a936-9499ab8da017 sending to next pipeline
2026-03-27 20:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1dcdfc7-42e3-5f56-a936-9499ab8da017, identifier: LF48909
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35353ab90>
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_661f9e307782a9d4272c4c654a796c83.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_661f9e307782a9d4272c4c654a796c83.jpg saved to cache
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80113859-0d8c-5c0c-b815-c99545b46316
2026-03-27 20:34:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352beebd0>
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_d1a28498c00fe5bd90a883d875bf5078.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_d1a28498c00fe5bd90a883d875bf5078.jpg saved to cache
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3f6612b-fe3c-5c29-8485-9b21469c7c41
2026-03-27 20:34:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352af47d0>
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_907c6ab1bd64c63c81eb2b69a805ae68.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_907c6ab1bd64c63c81eb2b69a805ae68.jpg saved to cache
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bee290>
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_13cd2fb8ea84437df4f598574d0bc76f.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_13cd2fb8ea84437df4f598574d0bc76f.jpg saved to cache
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349
2026-03-27 20:34:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b29090>
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_90bd0593ff896b565787dfb1921c4494.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_90bd0593ff896b565787dfb1921c4494.jpg saved to cache
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3f6612b-fe3c-5c29-8485-9b21469c7c41
2026-03-27 20:34:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf5850>
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F36%252Fef363737e4b0c37c27e7866279e225bc%252Fpa%252FHT96077_d9f4e139f24515cf05a8588925444bea.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_d9f4e139f24515cf05a8588925444bea.jpg saved to cache
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3f6612b-fe3c-5c29-8485-9b21469c7c41
2026-03-27 20:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3f6612b-fe3c-5c29-8485-9b21469c7c41, skipping ID generation
2026-03-27 20:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f6612b-fe3c-5c29-8485-9b21469c7c41 with scrape type 1
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3f6612b-fe3c-5c29-8485-9b21469c7c41 sending to next pipeline
2026-03-27 20:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3f6612b-fe3c-5c29-8485-9b21469c7c41, identifier: HT96077
2026-03-27 20:34:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353578550>
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_d965dbabad20549f58683994dda99b48.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_d965dbabad20549f58683994dda99b48.jpg saved to cache
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ac0810>
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_7f590cd2421bb4a86e7b056abec92470.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_7f590cd2421bb4a86e7b056abec92470.jpg saved to cache
2026-03-27 20:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349
2026-03-27 20:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1dcdfc7-42e3-5f56-a936-9499ab8da017 with identifier: LF48909
2026-03-27 20:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1dcdfc7-42e3-5f56-a936-9499ab8da017 with identifier: LF48909
2026-03-27 20:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1dcdfc7-42e3-5f56-a936-9499ab8da017 with identifier: LF48909 to the API
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_667469d7aa979fc4525c2e4784d298a6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:31:57Z',
 'fuel_type': 'diesel',
 'id': 'd1dcdfc7-42e3-5f56-a936-9499ab8da017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF48909',
 'listing': 'auction',
 'location': 'BE, Awans',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 327534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_31b369da8eb5d4cb3fb61f69e3687807.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_8098a60acb6044745b8badb28559a4f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_667469d7aa979fc4525c2e4784d298a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_551df90ce0a96d695890b3fafaaec5f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_c1321fc65ec9776cf43eb50b3225bdb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_1d0ed55970a39119075a92f9841af9bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_76d6bdf6e1dbcce9615199902f146dca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_086595a3629a05f9fb0c2c7eaa8670d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_18f96e4203edd38ea1856e4ca308edfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1dcdfc7-42e3-5f56-a936-9499ab8da017/d1dcdfc7-42e3-5f56-a936-9499ab8da017_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/bf/4cbf9fe13e5a8366e5721b996a3a6260/pa/LF48909_1ba9765c014e706890159b1daf10e4d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF48909%27 HTTP/1.1" 200 None
2026-03-27 20:34:22 [auto1.be] INFO: Saving data for LF48909: {'created_time': 1774643662.060003, 'last_price_update_time': 1774643662.060013, 'auction_closing_time': 1774715517.0}
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LF48909') HTTP/1.1" 204 0
2026-03-27 20:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077
2026-03-27 20:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077
2026-03-27 20:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077 to the API
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_d9f4e139f24515cf05a8588925444bea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 182,
 'expiration_date': '2026-03-28T16:17:26Z',
 'fuel_type': 'petrol',
 'id': 'c3f6612b-fe3c-5c29-8485-9b21469c7c41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT96077',
 'listing': 'auction',
 'location': 'Tradein',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 104604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3157611,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_45676433498c9c2a1dfe08f327a09699.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2988138,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_256946493b9dc61649463a209919fe94.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_c94ab5ab8140d6f237bc0d8f9f0c79f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570803,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_bde1bd858fd4c5cce218e70f0e92916a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3210471,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_90bd0593ff896b565787dfb1921c4494.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_b171e1eaf81c1d10bf4dfb6b5dc4ae77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_703985524d86f5c9ef836d3fc8903760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_0b4b6b428071dfbe0d1f06f195c9b294.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2921397,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_d1a28498c00fe5bd90a883d875bf5078.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f6612b-fe3c-5c29-8485-9b21469c7c41/c3f6612b-fe3c-5c29-8485-9b21469c7c41_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3369052,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/36/ef363737e4b0c37c27e7866279e225bc/pa/HT96077_d9f4e139f24515cf05a8588925444bea.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-27 20:34:22 [auto1.be] INFO: Saving data for HT96077: {'created_time': 1774643662.412123, 'last_price_update_time': 1774643662.412135, 'auction_closing_time': 1774714646.0}
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT96077') HTTP/1.1" 204 0
2026-03-27 20:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b5ab50>
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_741a6e7239fd1173d905a415689cbcfb.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_741a6e7239fd1173d905a415689cbcfb.jpg saved to cache
2026-03-27 20:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b18290>
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_c2fb363a7316201992794c2f9f8f6f5b.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_c2fb363a7316201992794c2f9f8f6f5b.jpg saved to cache
2026-03-27 20:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352862610>
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_82cae0a4978c3689d4e740cae72958df.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_82cae0a4978c3689d4e740cae72958df.jpg saved to cache
2026-03-27 20:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534713d0>
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_7e16b57a935a1b78387031b6e982d826.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_7e16b57a935a1b78387031b6e982d826.jpg saved to cache
2026-03-27 20:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9
2026-03-27 20:34:22 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1659 | hits on page: 40
2026-03-27 20:34:22 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-27 20:34:22 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-27 20:34:22 [auto1.be] INFO: Scrape type for CR22525: 1
2026-03-27 20:34:22 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-27 20:34:22 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-27 20:34:22 [auto1.be] INFO: Scrape type for BC69430: 2
2026-03-27 20:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430
2026-03-27 20:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4441441f-4e8f-5b4c-9ffe-357852997dc4 with scrape type 2
2026-03-27 20:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4441441f-4e8f-5b4c-9ffe-357852997dc4 with scrape type 2
2026-03-27 20:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4441441f-4e8f-5b4c-9ffe-357852997dc4, identifier: BC69430
2026-03-27 20:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430
2026-03-27 20:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430
2026-03-27 20:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430 to the API
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:41Z',
 'fuel_type': 'diesel',
 'id': '4441441f-4e8f-5b4c-9ffe-357852997dc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC69430',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 206234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-01',
 'seller_name': None,
 'title': 'BMW 3er 318d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2015}
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-27 20:34:23 [auto1.be] INFO: Saving data for BC69430: {'auction_closing_time': 1774714961.0, 'created_time': 1773909036.439363, 'last_price_update_time': 1774643663.063479}
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC69430') HTTP/1.1" 204 0
2026-03-27 20:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_acd278ca23a2ae1a8fc463a074460417.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_95e7bd0611cf9559587d594c7df50faa.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_3e1109d9813ce98648923b94c3e99bf5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_9ef26c60937bff697cafbb5f6b38c394.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: VT14549
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: WG79733
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: BB02902
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB02902%27 HTTP/1.1" 200 None
2026-03-27 20:34:23 [auto1.be] INFO: Scrape type for BB02902: 1
2026-03-27 20:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_b396b1806d67224b54c9dd29d9d46040.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-27 20:34:23 [auto1.be] INFO: Scrape type for AX12673: 1
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-27 20:34:23 [auto1.be] INFO: Scrape type for HY58683: 1
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-27 20:34:23 [auto1.be] INFO: Scrape type for CG91643: 2
2026-03-27 20:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643
2026-03-27 20:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd084fc6-6df2-5506-a224-00931fb25511 with scrape type 2
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd084fc6-6df2-5506-a224-00931fb25511 with scrape type 2
2026-03-27 20:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd084fc6-6df2-5506-a224-00931fb25511, identifier: CG91643
2026-03-27 20:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643
2026-03-27 20:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643
2026-03-27 20:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643 to the API
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:15:06Z',
 'fuel_type': 'diesel',
 'id': 'bd084fc6-6df2-5506-a224-00931fb25511',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG91643',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 190717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2019}
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-27 20:34:23 [auto1.be] INFO: Saving data for CG91643: {'auction_closing_time': 1774714506.0, 'created_time': 1773779683.372451, 'last_price_update_time': 1774643663.618291}
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG91643') HTTP/1.1" 204 0
2026-03-27 20:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_e7bf88a7883093054153d054d4fe90e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_e18b9d8c582c70c0cac09eaeea41c077.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-27 20:34:23 [auto1.be] INFO: Scrape type for HT09098: 1
2026-03-27 20:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_856b1681af7f31b329295944f2cddd0e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529a21d0>
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_acd278ca23a2ae1a8fc463a074460417.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_acd278ca23a2ae1a8fc463a074460417.jpg saved to cache
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35288cdd0>
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_95e7bd0611cf9559587d594c7df50faa.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_95e7bd0611cf9559587d594c7df50faa.jpg saved to cache
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353595e90>
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_3e1109d9813ce98648923b94c3e99bf5.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_3e1109d9813ce98648923b94c3e99bf5.jpg saved to cache
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353403bd0>
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_9ef26c60937bff697cafbb5f6b38c394.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_9ef26c60937bff697cafbb5f6b38c394.jpg saved to cache
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353596cd0>
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F93%252Fbd93c70a7dc511d23c7fd37a68b4a7e7%252Fpa%252FWD81319_b396b1806d67224b54c9dd29d9d46040.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_b396b1806d67224b54c9dd29d9d46040.jpg saved to cache
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349
2026-03-27 20:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349, skipping ID generation
2026-03-27 20:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with scrape type 1
2026-03-27 20:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 sending to next pipeline
2026-03-27 20:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349, identifier: WD81319
2026-03-27 20:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_b757a832b3e3cac8e24e6542a0ee88ba.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_0ef61297b99600fdd371edf9ca74f507.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: GB76910
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: WF72066
2026-03-27 20:34:23 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-27 20:34:23 [auto1.be] INFO: Scrape type for PB25162: 1
2026-03-27 20:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319
2026-03-27 20:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319
2026-03-27 20:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319 to the API
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_b396b1806d67224b54c9dd29d9d46040.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:45:14Z',
 'fuel_type': 'petrol',
 'id': '09ee685d-6fce-52ec-9f94-6ed2aaf8c349',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD81319',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 61727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_e9082aaf9f4ee3b7eebbf35daa2eb765.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_9818858fb7e824127269c3c54bfc4cca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_5a22d269172fe041a0d284e65ebed5a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_b396b1806d67224b54c9dd29d9d46040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_7f590cd2421bb4a86e7b056abec92470.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_13cd2fb8ea84437df4f598574d0bc76f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_3e1109d9813ce98648923b94c3e99bf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_95e7bd0611cf9559587d594c7df50faa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_c2fb363a7316201992794c2f9f8f6f5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ee685d-6fce-52ec-9f94-6ed2aaf8c349/09ee685d-6fce-52ec-9f94-6ed2aaf8c349_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/93/bd93c70a7dc511d23c7fd37a68b4a7e7/pa/WD81319_741a6e7239fd1173d905a415689cbcfb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-27 20:34:24 [auto1.be] INFO: Saving data for WD81319: {'created_time': 1774643664.285306, 'last_price_update_time': 1774643664.285316, 'auction_closing_time': 1774716314.0}
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WD81319') HTTP/1.1" 204 0
2026-03-27 20:34:24 [auto1.be] INFO: Found listing with ID: RR14818
2026-03-27 20:34:24 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-27 20:34:24 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-27 20:34:24 [auto1.be] INFO: Scrape type for SD15124: 1
2026-03-27 20:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_a73021e2556613bcf09c20331c334ef4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_6ab36f713108b6e2fe10e4f9aa609454.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_d50d420bc5efc3c0b1bf6ae9bef7db51.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:24 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-27 20:34:24 [auto1.be] INFO: Scrape type for YJ00240: 1
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352864ad0>
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_e7bf88a7883093054153d054d4fe90e9.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_e7bf88a7883093054153d054d4fe90e9.jpg saved to cache
2026-03-27 20:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9117a7d2-6ea7-56b3-863c-fd27deb06dcb
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35284f590>
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_e18b9d8c582c70c0cac09eaeea41c077.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_e18b9d8c582c70c0cac09eaeea41c077.jpg saved to cache
2026-03-27 20:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80113859-0d8c-5c0c-b815-c99545b46316
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b23950>
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F48%252F4c486dac66ebc0c308330a21ad565056%252Fpa%252FRK20492_856b1681af7f31b329295944f2cddd0e.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_856b1681af7f31b329295944f2cddd0e.jpg saved to cache
2026-03-27 20:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80113859-0d8c-5c0c-b815-c99545b46316
2026-03-27 20:34:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80113859-0d8c-5c0c-b815-c99545b46316, skipping ID generation
2026-03-27 20:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80113859-0d8c-5c0c-b815-c99545b46316 with scrape type 1
2026-03-27 20:34:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80113859-0d8c-5c0c-b815-c99545b46316 sending to next pipeline
2026-03-27 20:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 80113859-0d8c-5c0c-b815-c99545b46316, identifier: RK20492
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35348dfd0>
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_b757a832b3e3cac8e24e6542a0ee88ba.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_b757a832b3e3cac8e24e6542a0ee88ba.jpg saved to cache
2026-03-27 20:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 78c4b978-7553-5b88-b410-5d869264a521
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3535c59d0>
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_0ef61297b99600fdd371edf9ca74f507.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_0ef61297b99600fdd371edf9ca74f507.jpg saved to cache
2026-03-27 20:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 78c4b978-7553-5b88-b410-5d869264a521
2026-03-27 20:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 80113859-0d8c-5c0c-b815-c99545b46316 with identifier: RK20492
2026-03-27 20:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 80113859-0d8c-5c0c-b815-c99545b46316 with identifier: RK20492
2026-03-27 20:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 80113859-0d8c-5c0c-b815-c99545b46316 with identifier: RK20492 to the API
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_856b1681af7f31b329295944f2cddd0e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:22:13Z',
 'fuel_type': 'diesel',
 'id': '80113859-0d8c-5c0c-b815-c99545b46316',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK20492',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 193118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_e18b9d8c582c70c0cac09eaeea41c077.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_776a1cf1acf707667fa20a12b42aa468.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_549a082e1d389a89de58b2d7ece7a775.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_2f0199c8f8d5bf2b8c38f670a248ab48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_856b1681af7f31b329295944f2cddd0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_661f9e307782a9d4272c4c654a796c83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_f0916c3060770be3adc78c9a8b02322a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_5658fd1de25f29560797992647b306a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_44c86109e08dcb5218fd0a8bec15afed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80113859-0d8c-5c0c-b815-c99545b46316/80113859-0d8c-5c0c-b815-c99545b46316_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/48/4c486dac66ebc0c308330a21ad565056/pa/RK20492_9ca1ce3428288f4a48743b199f8f04c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.6 CDTI DPF Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2017}
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK20492%27 HTTP/1.1" 200 None
2026-03-27 20:34:25 [auto1.be] INFO: Saving data for RK20492: {'created_time': 1774643665.043924, 'last_price_update_time': 1774643665.043963, 'auction_closing_time': 1774714933.0}
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK20492') HTTP/1.1" 204 0
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: RC34183
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: YL56745
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL56745%27 HTTP/1.1" 200 None
2026-03-27 20:34:25 [auto1.be] INFO: Scrape type for YL56745: 2
2026-03-27 20:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 886ae80a-e809-5d88-88ca-39aa1c9313f5 with identifier: YL56745
2026-03-27 20:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 886ae80a-e809-5d88-88ca-39aa1c9313f5 with scrape type 2
2026-03-27 20:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 886ae80a-e809-5d88-88ca-39aa1c9313f5 with scrape type 2
2026-03-27 20:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 886ae80a-e809-5d88-88ca-39aa1c9313f5, identifier: YL56745
2026-03-27 20:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_419c777ad90074dd172c198f9110d6fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 886ae80a-e809-5d88-88ca-39aa1c9313f5 with identifier: YL56745
2026-03-27 20:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 886ae80a-e809-5d88-88ca-39aa1c9313f5 with identifier: YL56745
2026-03-27 20:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 886ae80a-e809-5d88-88ca-39aa1c9313f5 with identifier: YL56745 to the API
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:41:11Z',
 'fuel_type': 'diesel',
 'id': '886ae80a-e809-5d88-88ca-39aa1c9313f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL56745',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Defender',
 'odometer': 152339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-16',
 'seller_name': None,
 'title': 'Land Rover Defender D200 110 S',
 'transmission': 'automatic',
 'trim': '110 S',
 'year': 2020}
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL56745%27 HTTP/1.1" 200 None
2026-03-27 20:34:25 [auto1.be] INFO: Saving data for YL56745: {'auction_closing_time': 1774716071.0, 'created_time': 1774471300.272704, 'last_price_update_time': 1774643665.437922}
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YL56745') HTTP/1.1" 204 0
2026-03-27 20:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_cd908599eeb15bde6376bfb77847487c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: ZW68449
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW68449%27 HTTP/1.1" 200 None
2026-03-27 20:34:25 [auto1.be] INFO: Scrape type for ZW68449: 1
2026-03-27 20:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_51d2d5af50677c568ca6ff9ca66ace6d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC19835> (referer: https://www.auto1.com/v1/car-details-view/KC19835/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB98158> (referer: https://www.auto1.com/v1/car-details-view/RB98158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352861910>
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_a73021e2556613bcf09c20331c334ef4.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_a73021e2556613bcf09c20331c334ef4.jpg saved to cache
2026-03-27 20:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78c4b978-7553-5b88-b410-5d869264a521
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352805150>
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_6ab36f713108b6e2fe10e4f9aa609454.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_6ab36f713108b6e2fe10e4f9aa609454.jpg saved to cache
2026-03-27 20:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78c4b978-7553-5b88-b410-5d869264a521
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3528040d0>
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_d50d420bc5efc3c0b1bf6ae9bef7db51.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_d50d420bc5efc3c0b1bf6ae9bef7db51.jpg saved to cache
2026-03-27 20:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7feb9c2c-cc83-5421-930e-834c5bfd5694
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME80219%27 HTTP/1.1" 200 None
2026-03-27 20:34:25 [auto1.be] INFO: Scrape type for ME80219: 0
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-27 20:34:25 [auto1.be] INFO: Scrape type for VT00410: 0
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-27 20:34:25 [auto1.be] INFO: Scrape type for WG89987: 0
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-27 20:34:25 [auto1.be] INFO: Scrape type for KE26750: 0
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-27 20:34:25 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-27 20:34:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV82025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR22525/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3535998d0>
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46797e85523fe4b799a2d27ee7c715f6%252Fpa%252FZT52703_419c777ad90074dd172c198f9110d6fa.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_419c777ad90074dd172c198f9110d6fa.jpg saved to cache
2026-03-27 20:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7feb9c2c-cc83-5421-930e-834c5bfd5694
2026-03-27 20:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7feb9c2c-cc83-5421-930e-834c5bfd5694, skipping ID generation
2026-03-27 20:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7feb9c2c-cc83-5421-930e-834c5bfd5694 with scrape type 1
2026-03-27 20:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7feb9c2c-cc83-5421-930e-834c5bfd5694 sending to next pipeline
2026-03-27 20:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7feb9c2c-cc83-5421-930e-834c5bfd5694, identifier: ZT52703
2026-03-27 20:34:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35359aa10>
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_cd908599eeb15bde6376bfb77847487c.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_cd908599eeb15bde6376bfb77847487c.jpg saved to cache
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9
2026-03-27 20:34:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bec190>
2026-03-27 20:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_51d2d5af50677c568ca6ff9ca66ace6d.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_51d2d5af50677c568ca6ff9ca66ace6d.jpg saved to cache
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9
2026-03-27 20:34:26 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1659 | hits on page: 40
2026-03-27 20:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835
2026-03-27 20:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with scrape type 1
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c27705c-c5f8-5a7b-baef-f8308811f3e0
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F22%252F9f2298a3803e35f7625ecb0db8820a07%252Fpa%252FKC19835_76c69a5b590d1aeff85ca55ce265ab87.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_76c69a5b590d1aeff85ca55ce265ab87.jpg already downloaded
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F22%252F9f2298a3803e35f7625ecb0db8820a07%252Fpa%252FKC19835_3f4d462155b87a4b2103b0d7f5409e6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_3f4d462155b87a4b2103b0d7f5409e6f.jpg already downloaded
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F22%252F9f2298a3803e35f7625ecb0db8820a07%252Fpa%252FKC19835_d588a41cb372cce4af61f08bf935b95f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_d588a41cb372cce4af61f08bf935b95f.jpg already downloaded
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F22%252F9f2298a3803e35f7625ecb0db8820a07%252Fpa%252FKC19835_bba345b67fbdfb7cb2552ad0e016873f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_bba345b67fbdfb7cb2552ad0e016873f.jpg already downloaded
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F22%252F9f2298a3803e35f7625ecb0db8820a07%252Fpa%252FKC19835_f0738baa90e078810cb07d062c613291.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_f0738baa90e078810cb07d062c613291.jpg already downloaded
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F22%252F9f2298a3803e35f7625ecb0db8820a07%252Fpa%252FKC19835_d7cdefcc4e1ab2fd15553468f2fc5257.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_d7cdefcc4e1ab2fd15553468f2fc5257.jpg already downloaded
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F22%252F9f2298a3803e35f7625ecb0db8820a07%252Fpa%252FKC19835_392ff0bad61a2f44bee0404a96639a9a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_392ff0bad61a2f44bee0404a96639a9a.jpg already downloaded
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F22%252F9f2298a3803e35f7625ecb0db8820a07%252Fpa%252FKC19835_e230520198e525649a8c41252e8d8b75.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_e230520198e525649a8c41252e8d8b75.jpg already downloaded
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F22%252F9f2298a3803e35f7625ecb0db8820a07%252Fpa%252FKC19835_77ca266889243f1bdfaae8b9e9f7ead8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_77ca266889243f1bdfaae8b9e9f7ead8.jpg already downloaded
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F22%252F9f2298a3803e35f7625ecb0db8820a07%252Fpa%252FKC19835_f9e9ba6d402ecacfdecdc9756fa47f3e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_f9e9ba6d402ecacfdecdc9756fa47f3e.jpg already downloaded
2026-03-27 20:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c27705c-c5f8-5a7b-baef-f8308811f3e0, identifier: KC19835
2026-03-27 20:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158
2026-03-27 20:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with scrape type 1
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_81d5966dc681ed4e248fb50bd2bbe7ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_81d5966dc681ed4e248fb50bd2bbe7ab.jpg not downloaded yet
2026-03-27 20:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703
2026-03-27 20:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703
2026-03-27 20:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703 to the API
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_419c777ad90074dd172c198f9110d6fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:18:41Z',
 'fuel_type': 'diesel',
 'id': '7feb9c2c-cc83-5421-930e-834c5bfd5694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT52703',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 315098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_75d4e0d5097cf9c76ae949eea448b58c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_5dd521be9544fd5319b073008ee146f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_419c777ad90074dd172c198f9110d6fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_c3a76d461d6b17d3cfcbc288c158402a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_d50d420bc5efc3c0b1bf6ae9bef7db51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7feb9c2c-cc83-5421-930e-834c5bfd5694/7feb9c2c-cc83-5421-930e-834c5bfd5694_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/79/46797e85523fe4b799a2d27ee7c715f6/pa/ZT52703_becb7d49a8e96c764aee9ac053a0ba46.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-27 20:34:26 [auto1.be] INFO: Saving data for ZT52703: {'created_time': 1774643666.867865, 'last_price_update_time': 1774643666.867874, 'auction_closing_time': 1774714721.0}
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZT52703') HTTP/1.1" 204 0
2026-03-27 20:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835
2026-03-27 20:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835
2026-03-27 20:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835 to the API
2026-03-27 20:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KC19835>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:23:53Z',
 'fuel_type': 'diesel',
 'id': '4c27705c-c5f8-5a7b-baef-f8308811f3e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC19835',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 83454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_76c69a5b590d1aeff85ca55ce265ab87.jpg',
                'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_3f4d462155b87a4b2103b0d7f5409e6f.jpg',
                'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_d588a41cb372cce4af61f08bf935b95f.jpg',
                'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_bba345b67fbdfb7cb2552ad0e016873f.jpg',
                'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_f0738baa90e078810cb07d062c613291.jpg',
                'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_d7cdefcc4e1ab2fd15553468f2fc5257.jpg',
                'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_392ff0bad61a2f44bee0404a96639a9a.jpg',
                'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_e230520198e525649a8c41252e8d8b75.jpg',
                'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_77ca266889243f1bdfaae8b9e9f7ead8.jpg',
                'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_f9e9ba6d402ecacfdecdc9756fa47f3e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c27705c-c5f8-5a7b-baef-f8308811f3e0/4c27705c-c5f8-5a7b-baef-f8308811f3e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_76c69a5b590d1aeff85ca55ce265ab87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c27705c-c5f8-5a7b-baef-f8308811f3e0/4c27705c-c5f8-5a7b-baef-f8308811f3e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_3f4d462155b87a4b2103b0d7f5409e6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c27705c-c5f8-5a7b-baef-f8308811f3e0/4c27705c-c5f8-5a7b-baef-f8308811f3e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_d588a41cb372cce4af61f08bf935b95f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c27705c-c5f8-5a7b-baef-f8308811f3e0/4c27705c-c5f8-5a7b-baef-f8308811f3e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_bba345b67fbdfb7cb2552ad0e016873f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c27705c-c5f8-5a7b-baef-f8308811f3e0/4c27705c-c5f8-5a7b-baef-f8308811f3e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_f0738baa90e078810cb07d062c613291.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c27705c-c5f8-5a7b-baef-f8308811f3e0/4c27705c-c5f8-5a7b-baef-f8308811f3e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_d7cdefcc4e1ab2fd15553468f2fc5257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c27705c-c5f8-5a7b-baef-f8308811f3e0/4c27705c-c5f8-5a7b-baef-f8308811f3e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_392ff0bad61a2f44bee0404a96639a9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c27705c-c5f8-5a7b-baef-f8308811f3e0/4c27705c-c5f8-5a7b-baef-f8308811f3e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_e230520198e525649a8c41252e8d8b75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c27705c-c5f8-5a7b-baef-f8308811f3e0/4c27705c-c5f8-5a7b-baef-f8308811f3e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_77ca266889243f1bdfaae8b9e9f7ead8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c27705c-c5f8-5a7b-baef-f8308811f3e0/4c27705c-c5f8-5a7b-baef-f8308811f3e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/22/9f2298a3803e35f7625ecb0db8820a07/pa/KC19835_f9e9ba6d402ecacfdecdc9756fa47f3e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI Start&Stop',
 'transmission': 'manual',
 'trim': 'Start&Stop',
 'year': 2020}
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Saving data for KC19835: {'created_time': 1774643667.164306, 'last_price_update_time': 1774643667.164318, 'auction_closing_time': 1774715033.0}
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KC19835') HTTP/1.1" 204 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for ZM54310: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for VP90118: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for RW14221: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for VB04696: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB11071%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for DB11071: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for UA98228: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for WH33984: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for DP96573: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD22160%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for BD22160: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for KD31542: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for LE55631: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB74591%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for KB74591: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for SZ60181: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for PY12122: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for UW21644: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for SC85120: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: BU79691
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for MC44479: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for WH41445: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for XC97675: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for JS91211: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for XT90325: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for ZK00678: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for ED59297: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for WD60187: 0
2026-03-27 20:34:27 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [auto1.be] INFO: Scrape type for CC17071: 0
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_da999f69b91c5808459da821a310e85c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_da999f69b91c5808459da821a310e85c.jpg not downloaded yet
2026-03-27 20:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_a3eb01804adb869b821c82101e651271.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_24731ea2a33052f5f7a6599a9c2e8663.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX12673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY58683/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB02902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_741d436c227f51e0110ad7fa1c7c76bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_741d436c227f51e0110ad7fa1c7c76bb.jpg not downloaded yet
2026-03-27 20:34:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_9c4a912941cdc03fe078614d12532336.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_9c4a912941cdc03fe078614d12532336.jpg not downloaded yet
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_d4c00f3f4db6072e0251f88ff90eaa02.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_d4c00f3f4db6072e0251f88ff90eaa02.jpg not downloaded yet
2026-03-27 20:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_81d5966dc681ed4e248fb50bd2bbe7ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_bbe17bc832216ae17aa30f0d4403eb33.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_bbe17bc832216ae17aa30f0d4403eb33.jpg not downloaded yet
2026-03-27 20:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_9c544cfb8c0f0c0291eb0a529d6218dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_6f57f407751df02efc8b0e53256d7582.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_6f57f407751df02efc8b0e53256d7582.jpg not downloaded yet
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_b3d26da72e946f9bb97844e8d86cb463.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_b3d26da72e946f9bb97844e8d86cb463.jpg not downloaded yet
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_c35c7030187001d362cf805e3d31dff4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_c35c7030187001d362cf805e3d31dff4.jpg not downloaded yet
2026-03-27 20:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_741d436c227f51e0110ad7fa1c7c76bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35351ca50>
2026-03-27 20:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F53%252Fc353434900a31c279dbc08a494dd126f%252Fpa%252FVK87411_a3eb01804adb869b821c82101e651271.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_a3eb01804adb869b821c82101e651271.jpg saved to cache
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9117a7d2-6ea7-56b3-863c-fd27deb06dcb
2026-03-27 20:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9117a7d2-6ea7-56b3-863c-fd27deb06dcb, skipping ID generation
2026-03-27 20:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9117a7d2-6ea7-56b3-863c-fd27deb06dcb with scrape type 1
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9117a7d2-6ea7-56b3-863c-fd27deb06dcb sending to next pipeline
2026-03-27 20:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9117a7d2-6ea7-56b3-863c-fd27deb06dcb, identifier: VK87411
2026-03-27 20:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353402b50>
2026-03-27 20:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_24731ea2a33052f5f7a6599a9c2e8663.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_24731ea2a33052f5f7a6599a9c2e8663.jpg saved to cache
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78c4b978-7553-5b88-b410-5d869264a521
2026-03-27 20:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_da999f69b91c5808459da821a310e85c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_9c4a912941cdc03fe078614d12532336.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_d4c00f3f4db6072e0251f88ff90eaa02.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_fc3512f61a5023f1541b1bce8a331cdf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_fc3512f61a5023f1541b1bce8a331cdf.jpg not downloaded yet
2026-03-27 20:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9117a7d2-6ea7-56b3-863c-fd27deb06dcb with identifier: VK87411
2026-03-27 20:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9117a7d2-6ea7-56b3-863c-fd27deb06dcb with identifier: VK87411
2026-03-27 20:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9117a7d2-6ea7-56b3-863c-fd27deb06dcb with identifier: VK87411 to the API
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_a3eb01804adb869b821c82101e651271.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:48:55Z',
 'fuel_type': 'petrol',
 'id': '9117a7d2-6ea7-56b3-863c-fd27deb06dcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK87411',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 147831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_6a57922ebb7e2a1633badeb4e4ae31a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_a3eb01804adb869b821c82101e651271.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_3088e81c83d10d7f59afd8a4009890c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_4254d5b67d958302160c6ed67c3db8ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_e7bf88a7883093054153d054d4fe90e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9117a7d2-6ea7-56b3-863c-fd27deb06dcb/9117a7d2-6ea7-56b3-863c-fd27deb06dcb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/53/c353434900a31c279dbc08a494dd126f/pa/VK87411_8ae1d6d09f2355c9252c1c2e0f019629.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2004}
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK87411%27 HTTP/1.1" 200 None
2026-03-27 20:34:28 [auto1.be] INFO: Saving data for VK87411: {'created_time': 1774643668.283928, 'last_price_update_time': 1774643668.283959, 'auction_closing_time': 1774716535.0}
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VK87411') HTTP/1.1" 204 0
2026-03-27 20:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_bbe17bc832216ae17aa30f0d4403eb33.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_b529622727c09051a5c569300f917af9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT09098/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529db110>
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_81d5966dc681ed4e248fb50bd2bbe7ab.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_81d5966dc681ed4e248fb50bd2bbe7ab.jpg saved to cache
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b
2026-03-27 20:34:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529d0890>
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F32%252Fb63271171bace74a976f2cdee1bea0d5%252Fpa%252FMC08958_9c544cfb8c0f0c0291eb0a529d6218dd.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_9c544cfb8c0f0c0291eb0a529d6218dd.jpg saved to cache
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9
2026-03-27 20:34:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b588d62-9de3-5617-9d65-e09ce1b4deb9, skipping ID generation
2026-03-27 20:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9 with scrape type 1
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b588d62-9de3-5617-9d65-e09ce1b4deb9 sending to next pipeline
2026-03-27 20:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4b588d62-9de3-5617-9d65-e09ce1b4deb9, identifier: MC08958
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b5ec50>
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_741d436c227f51e0110ad7fa1c7c76bb.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_741d436c227f51e0110ad7fa1c7c76bb.jpg saved to cache
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529db1d0>
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_da999f69b91c5808459da821a310e85c.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_da999f69b91c5808459da821a310e85c.jpg saved to cache
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352bf47d0>
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_9c4a912941cdc03fe078614d12532336.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_9c4a912941cdc03fe078614d12532336.jpg saved to cache
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529087d0>
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_d4c00f3f4db6072e0251f88ff90eaa02.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_d4c00f3f4db6072e0251f88ff90eaa02.jpg saved to cache
2026-03-27 20:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b
2026-03-27 20:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_6f57f407751df02efc8b0e53256d7582.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_c35c7030187001d362cf805e3d31dff4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4b588d62-9de3-5617-9d65-e09ce1b4deb9 with identifier: MC08958
2026-03-27 20:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4b588d62-9de3-5617-9d65-e09ce1b4deb9 with identifier: MC08958
2026-03-27 20:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4b588d62-9de3-5617-9d65-e09ce1b4deb9 with identifier: MC08958 to the API
2026-03-27 20:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_9c544cfb8c0f0c0291eb0a529d6218dd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 241,
 'expiration_date': '2026-03-28T16:21:18Z',
 'fuel_type': 'hybrid',
 'id': '4b588d62-9de3-5617-9d65-e09ce1b4deb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC08958',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 110227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2225101,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_d965dbabad20549f58683994dda99b48.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2151059,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_907c6ab1bd64c63c81eb2b69a805ae68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_4761a8c534d40b3b5ffeb2b8fbfb8616.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_9ef26c60937bff697cafbb5f6b38c394.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2105238,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_cd908599eeb15bde6376bfb77847487c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_7e16b57a935a1b78387031b6e982d826.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_acd278ca23a2ae1a8fc463a074460417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2176168,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_9c544cfb8c0f0c0291eb0a529d6218dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2172207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_51d2d5af50677c568ca6ff9ca66ace6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b588d62-9de3-5617-9d65-e09ce1b4deb9/4b588d62-9de3-5617-9d65-e09ce1b4deb9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/32/b63271171bace74a976f2cdee1bea0d5/pa/MC08958_82cae0a4978c3689d4e740cae72958df.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2021}
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC08958%27 HTTP/1.1" 200 None
2026-03-27 20:34:29 [auto1.be] INFO: Saving data for MC08958: {'created_time': 1774643669.233694, 'last_price_update_time': 1774643669.233704, 'auction_closing_time': 1774714878.0}
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MC08958') HTTP/1.1" 204 0
2026-03-27 20:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_b3d26da72e946f9bb97844e8d86cb463.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY69823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD15124/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB25162/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35293b150>
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_bbe17bc832216ae17aa30f0d4403eb33.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_bbe17bc832216ae17aa30f0d4403eb33.jpg saved to cache
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353497090>
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb126b8f3bc14d0c0d8e84b1216b0389%252Fpa%252FRM51088_b529622727c09051a5c569300f917af9.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_b529622727c09051a5c569300f917af9.jpg saved to cache
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78c4b978-7553-5b88-b410-5d869264a521
2026-03-27 20:34:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78c4b978-7553-5b88-b410-5d869264a521, skipping ID generation
2026-03-27 20:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c4b978-7553-5b88-b410-5d869264a521 with scrape type 1
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78c4b978-7553-5b88-b410-5d869264a521 sending to next pipeline
2026-03-27 20:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78c4b978-7553-5b88-b410-5d869264a521, identifier: RM51088
2026-03-27 20:34:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088
2026-03-27 20:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088
2026-03-27 20:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088 to the API
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_b529622727c09051a5c569300f917af9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:35:26Z',
 'fuel_type': 'diesel',
 'id': '78c4b978-7553-5b88-b410-5d869264a521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM51088',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 74889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_29ebe23b2a4f3e1c253acb657057d99d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_7e295af29b1f8a957b1cca19bdad5542.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_732f30d299a014ca6e36e247417f99d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_d89aded0b3f0ae9e75253f0ed9764f40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_b529622727c09051a5c569300f917af9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_24731ea2a33052f5f7a6599a9c2e8663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_a73021e2556613bcf09c20331c334ef4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_6ab36f713108b6e2fe10e4f9aa609454.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_b757a832b3e3cac8e24e6542a0ee88ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c4b978-7553-5b88-b410-5d869264a521/78c4b978-7553-5b88-b410-5d869264a521_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db126b8f3bc14d0c0d8e84b1216b0389/pa/RM51088_0ef61297b99600fdd371edf9ca74f507.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen DS3 1.6 e-HDi Red Edition',
 'transmission': 'manual',
 'trim': 'Red Edition',
 'year': 2015}
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-27 20:34:29 [auto1.be] INFO: Saving data for RM51088: {'created_time': 1774643669.746717, 'last_price_update_time': 1774643669.746728, 'auction_closing_time': 1774715726.0}
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RM51088') HTTP/1.1" 204 0
2026-03-27 20:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_fc3512f61a5023f1541b1bce8a331cdf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353492fd0>
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_6f57f407751df02efc8b0e53256d7582.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_6f57f407751df02efc8b0e53256d7582.jpg saved to cache
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a50c10>
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_c35c7030187001d362cf805e3d31dff4.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_c35c7030187001d362cf805e3d31dff4.jpg saved to cache
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ac47d0>
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_b3d26da72e946f9bb97844e8d86cb463.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_b3d26da72e946f9bb97844e8d86cb463.jpg saved to cache
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ac7350>
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F03%252Faf03b6387b2693948c7dc50fd4d16419%252Fpa%252FRB98158_fc3512f61a5023f1541b1bce8a331cdf.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_fc3512f61a5023f1541b1bce8a331cdf.jpg saved to cache
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b
2026-03-27 20:34:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b, skipping ID generation
2026-03-27 20:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with scrape type 1
2026-03-27 20:34:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b sending to next pipeline
2026-03-27 20:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b, identifier: RB98158
2026-03-27 20:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158
2026-03-27 20:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158
2026-03-27 20:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158 to the API
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_fc3512f61a5023f1541b1bce8a331cdf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.3L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:04Z',
 'fuel_type': 'diesel',
 'id': '1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB98158',
 'listing': 'auction',
 'location': 'BE, Ardooie',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 213660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_81d5966dc681ed4e248fb50bd2bbe7ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_da999f69b91c5808459da821a310e85c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_741d436c227f51e0110ad7fa1c7c76bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_9c4a912941cdc03fe078614d12532336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_d4c00f3f4db6072e0251f88ff90eaa02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_bbe17bc832216ae17aa30f0d4403eb33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_6f57f407751df02efc8b0e53256d7582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_b3d26da72e946f9bb97844e8d86cb463.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_c35c7030187001d362cf805e3d31dff4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b/1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/03/af03b6387b2693948c7dc50fd4d16419/pa/RB98158_fc3512f61a5023f1541b1bce8a331cdf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-08',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2014}
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-27 20:34:30 [auto1.be] INFO: Saving data for RB98158: {'created_time': 1774643670.43135, 'last_price_update_time': 1774643670.431359, 'auction_closing_time': 1774715644.0}
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RB98158') HTTP/1.1" 204 0
2026-03-27 20:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW68449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ00240/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL87749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR22525> (referer: https://www.auto1.com/v1/car-details-view/CR22525/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525
2026-03-27 20:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9191288-0176-59a8-911f-1ca9935b23e1 with scrape type 1
2026-03-27 20:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9191288-0176-59a8-911f-1ca9935b23e1
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F26%252F3426c78d24663d124da165264f280b57%252Fpa%252FCR22525_a4751862e3af347db16108c8311874e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_a4751862e3af347db16108c8311874e0.jpg already downloaded
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F26%252F3426c78d24663d124da165264f280b57%252Fpa%252FCR22525_4c5d2e0a3779f6da1cc652a6f46b3cfa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_4c5d2e0a3779f6da1cc652a6f46b3cfa.jpg already downloaded
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F26%252F3426c78d24663d124da165264f280b57%252Fpa%252FCR22525_5185008e229e05d8927175f91eee224f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_5185008e229e05d8927175f91eee224f.jpg already downloaded
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F26%252F3426c78d24663d124da165264f280b57%252Fpa%252FCR22525_e3108e930cb0d7d327e0bab313141470.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_e3108e930cb0d7d327e0bab313141470.jpg already downloaded
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F26%252F3426c78d24663d124da165264f280b57%252Fpa%252FCR22525_8ef8e8bb218b8e8e0adae3ee142335e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_8ef8e8bb218b8e8e0adae3ee142335e7.jpg already downloaded
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F26%252F3426c78d24663d124da165264f280b57%252Fpa%252FCR22525_b5d99762efbdda9f60a776fef25600ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_b5d99762efbdda9f60a776fef25600ca.jpg already downloaded
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F26%252F3426c78d24663d124da165264f280b57%252Fpa%252FCR22525_87cdb615d1e535b6dfaa55635be46e02.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_87cdb615d1e535b6dfaa55635be46e02.jpg already downloaded
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F26%252F3426c78d24663d124da165264f280b57%252Fpa%252FCR22525_8c3cc6aff2adb8c95ea6dfe0a0d26753.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_8c3cc6aff2adb8c95ea6dfe0a0d26753.jpg already downloaded
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F26%252F3426c78d24663d124da165264f280b57%252Fpa%252FCR22525_85f41cf74f6a8672fa2fe5056ac2923e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_85f41cf74f6a8672fa2fe5056ac2923e.jpg already downloaded
2026-03-27 20:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F26%252F3426c78d24663d124da165264f280b57%252Fpa%252FCR22525_8fff5fd35392a6d95069282b32e61237.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_8fff5fd35392a6d95069282b32e61237.jpg already downloaded
2026-03-27 20:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9191288-0176-59a8-911f-1ca9935b23e1, identifier: CR22525
2026-03-27 20:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525
2026-03-27 20:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525
2026-03-27 20:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525 to the API
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CR22525>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:22:16Z',
 'fuel_type': 'petrol',
 'id': 'f9191288-0176-59a8-911f-1ca9935b23e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR22525',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 46268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_a4751862e3af347db16108c8311874e0.jpg',
                'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_4c5d2e0a3779f6da1cc652a6f46b3cfa.jpg',
                'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_5185008e229e05d8927175f91eee224f.jpg',
                'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_e3108e930cb0d7d327e0bab313141470.jpg',
                'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_8ef8e8bb218b8e8e0adae3ee142335e7.jpg',
                'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_b5d99762efbdda9f60a776fef25600ca.jpg',
                'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_87cdb615d1e535b6dfaa55635be46e02.jpg',
                'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_8c3cc6aff2adb8c95ea6dfe0a0d26753.jpg',
                'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_85f41cf74f6a8672fa2fe5056ac2923e.jpg',
                'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_8fff5fd35392a6d95069282b32e61237.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9191288-0176-59a8-911f-1ca9935b23e1/f9191288-0176-59a8-911f-1ca9935b23e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_a4751862e3af347db16108c8311874e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9191288-0176-59a8-911f-1ca9935b23e1/f9191288-0176-59a8-911f-1ca9935b23e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2718411,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_4c5d2e0a3779f6da1cc652a6f46b3cfa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9191288-0176-59a8-911f-1ca9935b23e1/f9191288-0176-59a8-911f-1ca9935b23e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2591062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_5185008e229e05d8927175f91eee224f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9191288-0176-59a8-911f-1ca9935b23e1/f9191288-0176-59a8-911f-1ca9935b23e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_e3108e930cb0d7d327e0bab313141470.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9191288-0176-59a8-911f-1ca9935b23e1/f9191288-0176-59a8-911f-1ca9935b23e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2569354,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_8ef8e8bb218b8e8e0adae3ee142335e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9191288-0176-59a8-911f-1ca9935b23e1/f9191288-0176-59a8-911f-1ca9935b23e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_b5d99762efbdda9f60a776fef25600ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9191288-0176-59a8-911f-1ca9935b23e1/f9191288-0176-59a8-911f-1ca9935b23e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2734795,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_87cdb615d1e535b6dfaa55635be46e02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9191288-0176-59a8-911f-1ca9935b23e1/f9191288-0176-59a8-911f-1ca9935b23e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_8c3cc6aff2adb8c95ea6dfe0a0d26753.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9191288-0176-59a8-911f-1ca9935b23e1/f9191288-0176-59a8-911f-1ca9935b23e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627058,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_85f41cf74f6a8672fa2fe5056ac2923e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9191288-0176-59a8-911f-1ca9935b23e1/f9191288-0176-59a8-911f-1ca9935b23e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/26/3426c78d24663d124da165264f280b57/pa/CR22525_8fff5fd35392a6d95069282b32e61237.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2024}
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [auto1.be] INFO: Saving data for CR22525: {'created_time': 1774643671.449393, 'last_price_update_time': 1774643671.449403, 'auction_closing_time': 1774714936.0}
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CR22525') HTTP/1.1" 204 0
2026-03-27 20:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB02902> (referer: https://www.auto1.com/v1/car-details-view/BB02902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV82025> (referer: https://www.auto1.com/v1/car-details-view/MV82025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY58683> (referer: https://www.auto1.com/v1/car-details-view/HY58683/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX12673> (referer: https://www.auto1.com/v1/car-details-view/AX12673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT09098> (referer: https://www.auto1.com/v1/car-details-view/HT09098/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 889598d6-83be-5f94-9dfd-ab22cf57336b with identifier: BB02902
2026-03-27 20:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889598d6-83be-5f94-9dfd-ab22cf57336b with scrape type 1
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 889598d6-83be-5f94-9dfd-ab22cf57336b
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ffd%252Ff1fde85ee972a9a1f04a17607c1fcf1a%252Fpa%252FBB02902_1a37e90b67f0027acd33a57308392636.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_1a37e90b67f0027acd33a57308392636.jpg already downloaded
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ffd%252Ff1fde85ee972a9a1f04a17607c1fcf1a%252Fpa%252FBB02902_ee50017a96bec4c2eb27967b3f942ca6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_ee50017a96bec4c2eb27967b3f942ca6.jpg already downloaded
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ffd%252Ff1fde85ee972a9a1f04a17607c1fcf1a%252Fpa%252FBB02902_4f302fb89d22574131fdbaaef27d87c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_4f302fb89d22574131fdbaaef27d87c1.jpg already downloaded
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ffd%252Ff1fde85ee972a9a1f04a17607c1fcf1a%252Fpa%252FBB02902_f2ac03c6e2067c2c2edaf8e52a17b744.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_f2ac03c6e2067c2c2edaf8e52a17b744.jpg already downloaded
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ffd%252Ff1fde85ee972a9a1f04a17607c1fcf1a%252Fpa%252FBB02902_376c7185014481e44c587068ef963922.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_376c7185014481e44c587068ef963922.jpg already downloaded
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ffd%252Ff1fde85ee972a9a1f04a17607c1fcf1a%252Fpa%252FBB02902_4f7401d24cdf5f26eabe6494577cfb47.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_4f7401d24cdf5f26eabe6494577cfb47.jpg already downloaded
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ffd%252Ff1fde85ee972a9a1f04a17607c1fcf1a%252Fpa%252FBB02902_731e46dd0617578b688b525d6f6ca07f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_731e46dd0617578b688b525d6f6ca07f.jpg already downloaded
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ffd%252Ff1fde85ee972a9a1f04a17607c1fcf1a%252Fpa%252FBB02902_8b2a5f00d4649c1bf7a7dff46e6b7265.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_8b2a5f00d4649c1bf7a7dff46e6b7265.jpg already downloaded
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ffd%252Ff1fde85ee972a9a1f04a17607c1fcf1a%252Fpa%252FBB02902_f1131f5bc9d796bf70d05dc92e56de72.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_f1131f5bc9d796bf70d05dc92e56de72.jpg already downloaded
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ffd%252Ff1fde85ee972a9a1f04a17607c1fcf1a%252Fpa%252FBB02902_460c43e2480119f60d5d5e3fb70204f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_460c43e2480119f60d5d5e3fb70204f0.jpg already downloaded
2026-03-27 20:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 889598d6-83be-5f94-9dfd-ab22cf57336b, identifier: BB02902
2026-03-27 20:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 889598d6-83be-5f94-9dfd-ab22cf57336b with identifier: BB02902
2026-03-27 20:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 889598d6-83be-5f94-9dfd-ab22cf57336b with identifier: BB02902
2026-03-27 20:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 889598d6-83be-5f94-9dfd-ab22cf57336b with identifier: BB02902 to the API
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BB02902>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:03:32Z',
 'fuel_type': 'diesel',
 'id': '889598d6-83be-5f94-9dfd-ab22cf57336b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB02902',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 90564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_1a37e90b67f0027acd33a57308392636.jpg',
                'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_ee50017a96bec4c2eb27967b3f942ca6.jpg',
                'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_4f302fb89d22574131fdbaaef27d87c1.jpg',
                'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_f2ac03c6e2067c2c2edaf8e52a17b744.jpg',
                'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_376c7185014481e44c587068ef963922.jpg',
                'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_4f7401d24cdf5f26eabe6494577cfb47.jpg',
                'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_731e46dd0617578b688b525d6f6ca07f.jpg',
                'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_8b2a5f00d4649c1bf7a7dff46e6b7265.jpg',
                'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_f1131f5bc9d796bf70d05dc92e56de72.jpg',
                'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_460c43e2480119f60d5d5e3fb70204f0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889598d6-83be-5f94-9dfd-ab22cf57336b/889598d6-83be-5f94-9dfd-ab22cf57336b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_1a37e90b67f0027acd33a57308392636.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889598d6-83be-5f94-9dfd-ab22cf57336b/889598d6-83be-5f94-9dfd-ab22cf57336b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_ee50017a96bec4c2eb27967b3f942ca6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889598d6-83be-5f94-9dfd-ab22cf57336b/889598d6-83be-5f94-9dfd-ab22cf57336b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_4f302fb89d22574131fdbaaef27d87c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889598d6-83be-5f94-9dfd-ab22cf57336b/889598d6-83be-5f94-9dfd-ab22cf57336b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_f2ac03c6e2067c2c2edaf8e52a17b744.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889598d6-83be-5f94-9dfd-ab22cf57336b/889598d6-83be-5f94-9dfd-ab22cf57336b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_376c7185014481e44c587068ef963922.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889598d6-83be-5f94-9dfd-ab22cf57336b/889598d6-83be-5f94-9dfd-ab22cf57336b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_4f7401d24cdf5f26eabe6494577cfb47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889598d6-83be-5f94-9dfd-ab22cf57336b/889598d6-83be-5f94-9dfd-ab22cf57336b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_731e46dd0617578b688b525d6f6ca07f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889598d6-83be-5f94-9dfd-ab22cf57336b/889598d6-83be-5f94-9dfd-ab22cf57336b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_8b2a5f00d4649c1bf7a7dff46e6b7265.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889598d6-83be-5f94-9dfd-ab22cf57336b/889598d6-83be-5f94-9dfd-ab22cf57336b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_f1131f5bc9d796bf70d05dc92e56de72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889598d6-83be-5f94-9dfd-ab22cf57336b/889598d6-83be-5f94-9dfd-ab22cf57336b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/fd/f1fde85ee972a9a1f04a17607c1fcf1a/pa/BB02902_460c43e2480119f60d5d5e3fb70204f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB02902%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [auto1.be] INFO: Saving data for BB02902: {'created_time': 1774643672.088814, 'last_price_update_time': 1774643672.088824, 'auction_closing_time': 1774713812.0}
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BB02902') HTTP/1.1" 204 0
2026-03-27 20:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB25162> (referer: https://www.auto1.com/v1/car-details-view/PB25162/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025
2026-03-27 20:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71215794-5397-5401-80c2-2542c4e8b4b2 with scrape type 1
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71215794-5397-5401-80c2-2542c4e8b4b2
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F0b%252F190b21a6d1364ddb266d89ea27e2e1a2%252Fpa%252FMV82025_f1b65d843d18cf194a2d22d179f6383e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_f1b65d843d18cf194a2d22d179f6383e.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F0b%252F190b21a6d1364ddb266d89ea27e2e1a2%252Fpa%252FMV82025_5a6f7df5e7bb3210a7efca3dd5b430ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_5a6f7df5e7bb3210a7efca3dd5b430ec.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F0b%252F190b21a6d1364ddb266d89ea27e2e1a2%252Fpa%252FMV82025_f10263a79e6f028183d8d3165d0da3ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_f10263a79e6f028183d8d3165d0da3ed.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F0b%252F190b21a6d1364ddb266d89ea27e2e1a2%252Fpa%252FMV82025_5c92efaa805a80e82aa8ee9ffafb4c4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_5c92efaa805a80e82aa8ee9ffafb4c4b.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F0b%252F190b21a6d1364ddb266d89ea27e2e1a2%252Fpa%252FMV82025_85d64fbf3b9df4df184a0d8bcabe1e6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_85d64fbf3b9df4df184a0d8bcabe1e6f.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F0b%252F190b21a6d1364ddb266d89ea27e2e1a2%252Fpa%252FMV82025_71219bbebfed5fb6ab48e78e6cfdcd55.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_71219bbebfed5fb6ab48e78e6cfdcd55.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F0b%252F190b21a6d1364ddb266d89ea27e2e1a2%252Fpa%252FMV82025_6d37332c5c8ccb21506449a5e52fa643.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_6d37332c5c8ccb21506449a5e52fa643.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F0b%252F190b21a6d1364ddb266d89ea27e2e1a2%252Fpa%252FMV82025_56a585f7f181149d518c49ae073ae2cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_56a585f7f181149d518c49ae073ae2cb.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F0b%252F190b21a6d1364ddb266d89ea27e2e1a2%252Fpa%252FMV82025_5f84209af73ac5f86e79a089683c8226.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_5f84209af73ac5f86e79a089683c8226.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F0b%252F190b21a6d1364ddb266d89ea27e2e1a2%252Fpa%252FMV82025_6d1f3d5587aafe7d9db5112ff0189823.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_6d1f3d5587aafe7d9db5112ff0189823.jpg already downloaded
2026-03-27 20:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 71215794-5397-5401-80c2-2542c4e8b4b2, identifier: MV82025
2026-03-27 20:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683
2026-03-27 20:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with scrape type 1
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fb7%252F7db70638a1f6b4147bfd3f00a6555109%252Fpa%252FHY58683_c6499ce422a59916e113d1ca835188a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_c6499ce422a59916e113d1ca835188a2.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fb7%252F7db70638a1f6b4147bfd3f00a6555109%252Fpa%252FHY58683_0415e45a2474274e90674513d7e72afe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_0415e45a2474274e90674513d7e72afe.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fb7%252F7db70638a1f6b4147bfd3f00a6555109%252Fpa%252FHY58683_b3438a31a41099238ff187387a0e157d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_b3438a31a41099238ff187387a0e157d.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fb7%252F7db70638a1f6b4147bfd3f00a6555109%252Fpa%252FHY58683_0ebe82efa01e78960ea2694ce8be6e0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_0ebe82efa01e78960ea2694ce8be6e0d.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fb7%252F7db70638a1f6b4147bfd3f00a6555109%252Fpa%252FHY58683_594480c29c9417a82e1ba23a172f28bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_594480c29c9417a82e1ba23a172f28bb.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fb7%252F7db70638a1f6b4147bfd3f00a6555109%252Fpa%252FHY58683_ce0356694c48f8d7bc1bdbaeba3e2aab.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_ce0356694c48f8d7bc1bdbaeba3e2aab.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fb7%252F7db70638a1f6b4147bfd3f00a6555109%252Fpa%252FHY58683_319c90d1b169b606339dbd6d429e7c8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_319c90d1b169b606339dbd6d429e7c8d.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fb7%252F7db70638a1f6b4147bfd3f00a6555109%252Fpa%252FHY58683_90a1d52a2cb35573a1265f7e8c85aaee.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_90a1d52a2cb35573a1265f7e8c85aaee.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fb7%252F7db70638a1f6b4147bfd3f00a6555109%252Fpa%252FHY58683_86d8aca61574b7dc6d7ee0a07cb5add3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_86d8aca61574b7dc6d7ee0a07cb5add3.jpg already downloaded
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fb7%252F7db70638a1f6b4147bfd3f00a6555109%252Fpa%252FHY58683_655580c8d39a061290b864bed72f0331.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_655580c8d39a061290b864bed72f0331.jpg already downloaded
2026-03-27 20:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc, identifier: HY58683
2026-03-27 20:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673
2026-03-27 20:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fba3529-108b-5d2a-b9e6-62c793f85b36 with scrape type 1
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6fba3529-108b-5d2a-b9e6-62c793f85b36
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_7d93fd26c4b99ffd4debfcc2b74bada1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_7d93fd26c4b99ffd4debfcc2b74bada1.jpg not downloaded yet
2026-03-27 20:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098
2026-03-27 20:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ceac93-e1c0-5054-97d1-2e87f4891b39 with scrape type 1
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5ceac93-e1c0-5054-97d1-2e87f4891b39
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_4c419a4f2735b6e4b99045481b19ffe6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_4c419a4f2735b6e4b99045481b19ffe6.jpg not downloaded yet
2026-03-27 20:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025
2026-03-27 20:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025
2026-03-27 20:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025 to the API
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MV82025>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:06:25Z',
 'fuel_type': 'petrol',
 'id': '71215794-5397-5401-80c2-2542c4e8b4b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV82025',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 117875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_f1b65d843d18cf194a2d22d179f6383e.jpg',
                'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_5a6f7df5e7bb3210a7efca3dd5b430ec.jpg',
                'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_f10263a79e6f028183d8d3165d0da3ed.jpg',
                'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_5c92efaa805a80e82aa8ee9ffafb4c4b.jpg',
                'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_85d64fbf3b9df4df184a0d8bcabe1e6f.jpg',
                'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_71219bbebfed5fb6ab48e78e6cfdcd55.jpg',
                'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_6d37332c5c8ccb21506449a5e52fa643.jpg',
                'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_56a585f7f181149d518c49ae073ae2cb.jpg',
                'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_5f84209af73ac5f86e79a089683c8226.jpg',
                'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_6d1f3d5587aafe7d9db5112ff0189823.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71215794-5397-5401-80c2-2542c4e8b4b2/71215794-5397-5401-80c2-2542c4e8b4b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_f1b65d843d18cf194a2d22d179f6383e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71215794-5397-5401-80c2-2542c4e8b4b2/71215794-5397-5401-80c2-2542c4e8b4b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_5a6f7df5e7bb3210a7efca3dd5b430ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71215794-5397-5401-80c2-2542c4e8b4b2/71215794-5397-5401-80c2-2542c4e8b4b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_f10263a79e6f028183d8d3165d0da3ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71215794-5397-5401-80c2-2542c4e8b4b2/71215794-5397-5401-80c2-2542c4e8b4b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_5c92efaa805a80e82aa8ee9ffafb4c4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71215794-5397-5401-80c2-2542c4e8b4b2/71215794-5397-5401-80c2-2542c4e8b4b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_85d64fbf3b9df4df184a0d8bcabe1e6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71215794-5397-5401-80c2-2542c4e8b4b2/71215794-5397-5401-80c2-2542c4e8b4b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_71219bbebfed5fb6ab48e78e6cfdcd55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71215794-5397-5401-80c2-2542c4e8b4b2/71215794-5397-5401-80c2-2542c4e8b4b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_6d37332c5c8ccb21506449a5e52fa643.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71215794-5397-5401-80c2-2542c4e8b4b2/71215794-5397-5401-80c2-2542c4e8b4b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_56a585f7f181149d518c49ae073ae2cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71215794-5397-5401-80c2-2542c4e8b4b2/71215794-5397-5401-80c2-2542c4e8b4b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_5f84209af73ac5f86e79a089683c8226.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71215794-5397-5401-80c2-2542c4e8b4b2/71215794-5397-5401-80c2-2542c4e8b4b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0b/190b21a6d1364ddb266d89ea27e2e1a2/pa/MV82025_6d1f3d5587aafe7d9db5112ff0189823.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-27 20:34:32 [auto1.be] INFO: Saving data for MV82025: {'created_time': 1774643672.972189, 'last_price_update_time': 1774643672.9722, 'auction_closing_time': 1774713985.0}
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MV82025') HTTP/1.1" 204 0
2026-03-27 20:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683
2026-03-27 20:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683
2026-03-27 20:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683 to the API
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HY58683>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:40:18Z',
 'fuel_type': 'diesel',
 'id': 'c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY58683',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 272404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_c6499ce422a59916e113d1ca835188a2.jpg',
                'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_0415e45a2474274e90674513d7e72afe.jpg',
                'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_b3438a31a41099238ff187387a0e157d.jpg',
                'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_0ebe82efa01e78960ea2694ce8be6e0d.jpg',
                'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_594480c29c9417a82e1ba23a172f28bb.jpg',
                'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_ce0356694c48f8d7bc1bdbaeba3e2aab.jpg',
                'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_319c90d1b169b606339dbd6d429e7c8d.jpg',
                'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_90a1d52a2cb35573a1265f7e8c85aaee.jpg',
                'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_86d8aca61574b7dc6d7ee0a07cb5add3.jpg',
                'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_655580c8d39a061290b864bed72f0331.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc/c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2488972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_c6499ce422a59916e113d1ca835188a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc/c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430695,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_0415e45a2474274e90674513d7e72afe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc/c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_b3438a31a41099238ff187387a0e157d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc/c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2563623,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_0ebe82efa01e78960ea2694ce8be6e0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc/c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2616698,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_594480c29c9417a82e1ba23a172f28bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc/c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2675747,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_ce0356694c48f8d7bc1bdbaeba3e2aab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc/c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2646971,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_319c90d1b169b606339dbd6d429e7c8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc/c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2449768,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_90a1d52a2cb35573a1265f7e8c85aaee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc/c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2285331,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_86d8aca61574b7dc6d7ee0a07cb5add3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc/c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3301379,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/b7/7db70638a1f6b4147bfd3f00a6555109/pa/HY58683_655580c8d39a061290b864bed72f0331.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Saving data for HY58683: {'created_time': 1774643673.265195, 'last_price_update_time': 1774643673.265205, 'auction_closing_time': 1774716018.0}
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY58683') HTTP/1.1" 204 0
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_58222fff279c8d2375fe0026914549e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_58222fff279c8d2375fe0026914549e1.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_93bbcff7062c735fd4ccbaea40fb3aeb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_93bbcff7062c735fd4ccbaea40fb3aeb.jpg not downloaded yet
2026-03-27 20:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD15124> (referer: https://www.auto1.com/v1/car-details-view/SD15124/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_96241a9b4800de442817020967f0a633.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_96241a9b4800de442817020967f0a633.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_7440bcc37aa6930a3fb0a147f17f0bd6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_7440bcc37aa6930a3fb0a147f17f0bd6.jpg not downloaded yet
2026-03-27 20:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162
2026-03-27 20:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77863e2a-4114-5928-bcad-56eaadd19805 with scrape type 1
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77863e2a-4114-5928-bcad-56eaadd19805
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_5a92b083b43f8e3f3e5e3b6ede2dd9d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_5a92b083b43f8e3f3e5e3b6ede2dd9d5.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_0cf7eccd071ea3f9946701f9772b36fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_0cf7eccd071ea3f9946701f9772b36fe.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_3582b6f688b00a85c1b9b8847e34042a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3582b6f688b00a85c1b9b8847e34042a.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_a5a16a75623c968734d87f7fe46d66f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_a5a16a75623c968734d87f7fe46d66f8.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_138a5f8cf7dac1feff1319329d0cd1fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_138a5f8cf7dac1feff1319329d0cd1fa.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_3cc253720c8ab77767abde0840a7b6cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3cc253720c8ab77767abde0840a7b6cc.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_754f0628dc289eee67f56ab8270a0606.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_754f0628dc289eee67f56ab8270a0606.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_f5f0d837d119cf1aee12555f53275628.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_f5f0d837d119cf1aee12555f53275628.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_0ecddb74ad76e3f9987900112c688350.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_0ecddb74ad76e3f9987900112c688350.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_bc8694f576783acf5dec3fe99b286ad9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_bc8694f576783acf5dec3fe99b286ad9.jpg not downloaded yet
2026-03-27 20:34:33 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1659 | hits on page: 40
2026-03-27 20:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124
2026-03-27 20:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47cebe66-925b-51d8-aa9d-271032bb0878 with scrape type 1
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47cebe66-925b-51d8-aa9d-271032bb0878
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_4868c6ebbaa5e21c693d7348143263d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_4868c6ebbaa5e21c693d7348143263d4.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_f680083d621894ddba520a487e91b331.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_f680083d621894ddba520a487e91b331.jpg not downloaded yet
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_8585b88a00f69a95ba8df22132884a36.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_8585b88a00f69a95ba8df22132884a36.jpg not downloaded yet
2026-03-27 20:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_5a92b083b43f8e3f3e5e3b6ede2dd9d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_fd42d5dba7309e9b4e3c1e9f0e465fc1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_fd42d5dba7309e9b4e3c1e9f0e465fc1.jpg not downloaded yet
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for EP09858: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for MF96479: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for KA88762: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: ET95220
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET95220%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for ET95220: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for KF52558: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for UJ89543: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for UX94260: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for FA63464: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for WA92632: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for FN16517: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for PS61885: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for KW38150: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for CU40853: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for KH63709: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: YL38834
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL38834%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for YL38834: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for MW76341: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for GF63829: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for SC04496: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: UY90554
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY90554%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for UY90554: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-27 20:34:33 [auto1.be] INFO: Scrape type for GW63299: 0
2026-03-27 20:34:33 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-27 20:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [auto1.be] INFO: Scrape type for MC66522: 0
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [auto1.be] INFO: Scrape type for RN56335: 0
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [auto1.be] INFO: Scrape type for ZK51965: 0
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [auto1.be] INFO: Scrape type for MS23670: 0
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [auto1.be] INFO: Scrape type for DC17534: 0
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [auto1.be] INFO: Scrape type for EJ45470: 0
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [auto1.be] INFO: Scrape type for TU11660: 0
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: JH99432
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH99432%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [auto1.be] INFO: Scrape type for JH99432: 0
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-27 20:34:34 [auto1.be] INFO: Found listing with ID: PY40839
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY40839%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [auto1.be] INFO: Scrape type for PY40839: 0
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_48ca6a83078fe3864b4a4c7b1c977b47.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_48ca6a83078fe3864b4a4c7b1c977b47.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_581ddb58f4e482b0b9e03a964c15d4e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_581ddb58f4e482b0b9e03a964c15d4e7.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_68882854923540403e08a1e2dc869860.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_68882854923540403e08a1e2dc869860.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_bf5fa7b4a06f9b8e140aa76b34878f36.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_bf5fa7b4a06f9b8e140aa76b34878f36.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_622378056788ef177951a89a4cd241d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_622378056788ef177951a89a4cd241d9.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_c89bec43960434ed60dd6b5058af9b68.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_c89bec43960434ed60dd6b5058af9b68.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_3623ee65b03f2e61ea51c13dec9692f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3623ee65b03f2e61ea51c13dec9692f6.jpg not downloaded yet
2026-03-27 20:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW68449> (referer: https://www.auto1.com/v1/car-details-view/ZW68449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL87749> (referer: https://www.auto1.com/v1/car-details-view/XL87749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ00240> (referer: https://www.auto1.com/v1/car-details-view/YJ00240/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_b2c5a44f548500ddf6d4bf5073acd93c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_b2c5a44f548500ddf6d4bf5073acd93c.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_8042451fa073f14004d01f8b3a3ca8cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_8042451fa073f14004d01f8b3a3ca8cc.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_c7ad3405c9e1df1d13f611aa5a6ae9c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_c7ad3405c9e1df1d13f611aa5a6ae9c6.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_93a6b8e36658671cc1e50cb2067ab8fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_93a6b8e36658671cc1e50cb2067ab8fd.jpg not downloaded yet
2026-03-27 20:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536a3290>
2026-03-27 20:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_5a92b083b43f8e3f3e5e3b6ede2dd9d5.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_5a92b083b43f8e3f3e5e3b6ede2dd9d5.jpg saved to cache
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77863e2a-4114-5928-bcad-56eaadd19805
2026-03-27 20:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_0cf7eccd071ea3f9946701f9772b36fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_65a3b92b3d43a7f9df98b29e6fc3a728.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_65a3b92b3d43a7f9df98b29e6fc3a728.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_138cb57f8291e46b694f5318c63e169f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_138cb57f8291e46b694f5318c63e169f.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_59ffd4657b9d3e48d5de19ee2bd87233.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_59ffd4657b9d3e48d5de19ee2bd87233.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_4f0fe2172c60459fbf7dbafe7ab1c164.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_4f0fe2172c60459fbf7dbafe7ab1c164.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_1210402ea410549cd98f70966751bdee.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_1210402ea410549cd98f70966751bdee.jpg not downloaded yet
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_79846a52fc27cdfe05383a2ec3df04a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_79846a52fc27cdfe05383a2ec3df04a9.jpg not downloaded yet
2026-03-27 20:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc078cf8-fb1d-5be3-b372-af514e3221f4 with identifier: ZW68449
2026-03-27 20:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc078cf8-fb1d-5be3-b372-af514e3221f4 with scrape type 1
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc078cf8-fb1d-5be3-b372-af514e3221f4
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_43a781e171de9855ee4ea34049ac1600.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_43a781e171de9855ee4ea34049ac1600.jpg not downloaded yet
2026-03-27 20:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12c5b220-e10a-5d3a-a856-7f399d547e65 with identifier: XL87749
2026-03-27 20:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12c5b220-e10a-5d3a-a856-7f399d547e65 with scrape type 1
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 12c5b220-e10a-5d3a-a856-7f399d547e65
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_a32ed9ac22c9dbbff02a107e6fa04ac1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_a32ed9ac22c9dbbff02a107e6fa04ac1.jpg not downloaded yet
2026-03-27 20:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240
2026-03-27 20:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c148a875-8b3a-5c20-b7bf-4f7bda84682a with scrape type 1
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c148a875-8b3a-5c20-b7bf-4f7bda84682a
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F86%252F0c861e7776323311c9a7c7396c893d48%252Fpa%252FYJ00240_e97262ce0b842c4c5601e448a03f654e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_e97262ce0b842c4c5601e448a03f654e.jpg already downloaded
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F86%252F0c861e7776323311c9a7c7396c893d48%252Fpa%252FYJ00240_371e4809cc86ad02c3f22ee0a4d6466e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_371e4809cc86ad02c3f22ee0a4d6466e.jpg already downloaded
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F86%252F0c861e7776323311c9a7c7396c893d48%252Fpa%252FYJ00240_2b5f79807c0889d8e022e1ed4dcfea3d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_2b5f79807c0889d8e022e1ed4dcfea3d.jpg already downloaded
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F86%252F0c861e7776323311c9a7c7396c893d48%252Fpa%252FYJ00240_a87768bb7d3e84bd230f040edd9be243.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_a87768bb7d3e84bd230f040edd9be243.jpg already downloaded
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F86%252F0c861e7776323311c9a7c7396c893d48%252Fpa%252FYJ00240_4a3ed64e797fdd14e449e5d87304a31c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_4a3ed64e797fdd14e449e5d87304a31c.jpg already downloaded
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F86%252F0c861e7776323311c9a7c7396c893d48%252Fpa%252FYJ00240_fe0cf5c92dabf11cbf780afb23bf7461.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_fe0cf5c92dabf11cbf780afb23bf7461.jpg already downloaded
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F86%252F0c861e7776323311c9a7c7396c893d48%252Fpa%252FYJ00240_6294c94ee8b382dca28f9dae0afda572.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_6294c94ee8b382dca28f9dae0afda572.jpg already downloaded
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F86%252F0c861e7776323311c9a7c7396c893d48%252Fpa%252FYJ00240_07a10b9b4616722f11bdb4a3760d3202.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_07a10b9b4616722f11bdb4a3760d3202.jpg already downloaded
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F86%252F0c861e7776323311c9a7c7396c893d48%252Fpa%252FYJ00240_b60b02b2f65c4228cb288989dd426ced.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_b60b02b2f65c4228cb288989dd426ced.jpg already downloaded
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F86%252F0c861e7776323311c9a7c7396c893d48%252Fpa%252FYJ00240_a4bad4fc9b54857ebc657dd5f171b908.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_a4bad4fc9b54857ebc657dd5f171b908.jpg already downloaded
2026-03-27 20:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c148a875-8b3a-5c20-b7bf-4f7bda84682a, identifier: YJ00240
2026-03-27 20:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240
2026-03-27 20:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240
2026-03-27 20:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240 to the API
2026-03-27 20:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ00240>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:30:52Z',
 'fuel_type': 'diesel',
 'id': 'c148a875-8b3a-5c20-b7bf-4f7bda84682a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ00240',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 259930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_e97262ce0b842c4c5601e448a03f654e.jpg',
                'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_371e4809cc86ad02c3f22ee0a4d6466e.jpg',
                'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_2b5f79807c0889d8e022e1ed4dcfea3d.jpg',
                'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_a87768bb7d3e84bd230f040edd9be243.jpg',
                'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_4a3ed64e797fdd14e449e5d87304a31c.jpg',
                'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_fe0cf5c92dabf11cbf780afb23bf7461.jpg',
                'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_6294c94ee8b382dca28f9dae0afda572.jpg',
                'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_07a10b9b4616722f11bdb4a3760d3202.jpg',
                'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_b60b02b2f65c4228cb288989dd426ced.jpg',
                'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_a4bad4fc9b54857ebc657dd5f171b908.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c148a875-8b3a-5c20-b7bf-4f7bda84682a/c148a875-8b3a-5c20-b7bf-4f7bda84682a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_e97262ce0b842c4c5601e448a03f654e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c148a875-8b3a-5c20-b7bf-4f7bda84682a/c148a875-8b3a-5c20-b7bf-4f7bda84682a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_371e4809cc86ad02c3f22ee0a4d6466e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c148a875-8b3a-5c20-b7bf-4f7bda84682a/c148a875-8b3a-5c20-b7bf-4f7bda84682a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_2b5f79807c0889d8e022e1ed4dcfea3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c148a875-8b3a-5c20-b7bf-4f7bda84682a/c148a875-8b3a-5c20-b7bf-4f7bda84682a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_a87768bb7d3e84bd230f040edd9be243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c148a875-8b3a-5c20-b7bf-4f7bda84682a/c148a875-8b3a-5c20-b7bf-4f7bda84682a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_4a3ed64e797fdd14e449e5d87304a31c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c148a875-8b3a-5c20-b7bf-4f7bda84682a/c148a875-8b3a-5c20-b7bf-4f7bda84682a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_fe0cf5c92dabf11cbf780afb23bf7461.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c148a875-8b3a-5c20-b7bf-4f7bda84682a/c148a875-8b3a-5c20-b7bf-4f7bda84682a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_6294c94ee8b382dca28f9dae0afda572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c148a875-8b3a-5c20-b7bf-4f7bda84682a/c148a875-8b3a-5c20-b7bf-4f7bda84682a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_07a10b9b4616722f11bdb4a3760d3202.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c148a875-8b3a-5c20-b7bf-4f7bda84682a/c148a875-8b3a-5c20-b7bf-4f7bda84682a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_b60b02b2f65c4228cb288989dd426ced.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c148a875-8b3a-5c20-b7bf-4f7bda84682a/c148a875-8b3a-5c20-b7bf-4f7bda84682a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/86/0c861e7776323311c9a7c7396c893d48/pa/YJ00240_a4bad4fc9b54857ebc657dd5f171b908.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2015}
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [auto1.be] INFO: Saving data for YJ00240: {'created_time': 1774643675.202451, 'last_price_update_time': 1774643675.202463, 'auction_closing_time': 1774715452.0}
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ00240') HTTP/1.1" 204 0
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_658ba02bcbfba3fa75ae1984a6ffc2b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_658ba02bcbfba3fa75ae1984a6ffc2b1.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_c95f8eb4179845e561e94681591016ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_c95f8eb4179845e561e94681591016ea.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_827a95ebce4e72934d587afceee86838.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_827a95ebce4e72934d587afceee86838.jpg not downloaded yet
2026-03-27 20:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_a5a16a75623c968734d87f7fe46d66f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_1bc7059d4aa80deac2c28f7e45ac14f9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_1bc7059d4aa80deac2c28f7e45ac14f9.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_b87daf9ae68a07b4f8ad2b6601a06bf8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_b87daf9ae68a07b4f8ad2b6601a06bf8.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_7162b497976a910cf9495ceaaf1f7d71.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_7162b497976a910cf9495ceaaf1f7d71.jpg not downloaded yet
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353503950>
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_0cf7eccd071ea3f9946701f9772b36fe.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_0cf7eccd071ea3f9946701f9772b36fe.jpg saved to cache
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fba3529-108b-5d2a-b9e6-62c793f85b36
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_a939227d323c87e5208d48c611add84d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_a939227d323c87e5208d48c611add84d.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_682fe79e5ecf37b78a41f2766abb9b57.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_682fe79e5ecf37b78a41f2766abb9b57.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_b4b76528635131ed0de9f40c9aabf86f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_b4b76528635131ed0de9f40c9aabf86f.jpg not downloaded yet
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ac1b50>
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_a5a16a75623c968734d87f7fe46d66f8.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_a5a16a75623c968734d87f7fe46d66f8.jpg saved to cache
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77863e2a-4114-5928-bcad-56eaadd19805
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_0befa35fd7d702fd4f356f6033df791e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_0befa35fd7d702fd4f356f6033df791e.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_ccbf307b84cf4c22a5399516860851f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_ccbf307b84cf4c22a5399516860851f5.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_7d3b00a3eff69f75536f3451316b7f59.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_7d3b00a3eff69f75536f3451316b7f59.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_d187b347517fd3a58ac6074b9e3fa223.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_d187b347517fd3a58ac6074b9e3fa223.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_492162313187b964803f19efb33d0040.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_492162313187b964803f19efb33d0040.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_ca5c10696c4470e2a09aaf9026acb08e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_ca5c10696c4470e2a09aaf9026acb08e.jpg not downloaded yet
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_8ffa54b6504fe2458ce84c16a3733a0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_8ffa54b6504fe2458ce84c16a3733a0e.jpg not downloaded yet
2026-03-27 20:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_754f0628dc289eee67f56ab8270a0606.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_5282a6d3eb49318e2e3c6f0c4c37c2a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_5282a6d3eb49318e2e3c6f0c4c37c2a9.jpg not downloaded yet
2026-03-27 20:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_7d93fd26c4b99ffd4debfcc2b74bada1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_58222fff279c8d2375fe0026914549e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_96241a9b4800de442817020967f0a633.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_4c419a4f2735b6e4b99045481b19ffe6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3582b6f688b00a85c1b9b8847e34042a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_93bbcff7062c735fd4ccbaea40fb3aeb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3cc253720c8ab77767abde0840a7b6cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529b6210>
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_754f0628dc289eee67f56ab8270a0606.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_754f0628dc289eee67f56ab8270a0606.jpg saved to cache
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77863e2a-4114-5928-bcad-56eaadd19805
2026-03-27 20:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_827a95ebce4e72934d587afceee86838.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352829cd0>
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_7d93fd26c4b99ffd4debfcc2b74bada1.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_7d93fd26c4b99ffd4debfcc2b74bada1.jpg saved to cache
2026-03-27 20:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fba3529-108b-5d2a-b9e6-62c793f85b36
2026-03-27 20:34:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353403010>
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_58222fff279c8d2375fe0026914549e1.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_58222fff279c8d2375fe0026914549e1.jpg saved to cache
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fba3529-108b-5d2a-b9e6-62c793f85b36
2026-03-27 20:34:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35354e490>
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_96241a9b4800de442817020967f0a633.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_96241a9b4800de442817020967f0a633.jpg saved to cache
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fba3529-108b-5d2a-b9e6-62c793f85b36
2026-03-27 20:34:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529361d0>
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_4c419a4f2735b6e4b99045481b19ffe6.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_4c419a4f2735b6e4b99045481b19ffe6.jpg saved to cache
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5ceac93-e1c0-5054-97d1-2e87f4891b39
2026-03-27 20:34:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ab6050>
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_3582b6f688b00a85c1b9b8847e34042a.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3582b6f688b00a85c1b9b8847e34042a.jpg saved to cache
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5ceac93-e1c0-5054-97d1-2e87f4891b39
2026-03-27 20:34:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352804490>
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_93bbcff7062c735fd4ccbaea40fb3aeb.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_93bbcff7062c735fd4ccbaea40fb3aeb.jpg saved to cache
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5ceac93-e1c0-5054-97d1-2e87f4891b39
2026-03-27 20:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_8ffa54b6504fe2458ce84c16a3733a0e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY69823> (referer: https://www.auto1.com/v1/car-details-view/CY69823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_4868c6ebbaa5e21c693d7348143263d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35354e210>
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_3cc253720c8ab77767abde0840a7b6cc.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3cc253720c8ab77767abde0840a7b6cc.jpg saved to cache
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5ceac93-e1c0-5054-97d1-2e87f4891b39
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3535c3f10>
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_827a95ebce4e72934d587afceee86838.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_827a95ebce4e72934d587afceee86838.jpg saved to cache
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12c5b220-e10a-5d3a-a856-7f399d547e65
2026-03-27 20:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_622378056788ef177951a89a4cd241d9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353561510>
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_8ffa54b6504fe2458ce84c16a3733a0e.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_8ffa54b6504fe2458ce84c16a3733a0e.jpg saved to cache
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc078cf8-fb1d-5be3-b372-af514e3221f4
2026-03-27 20:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35383e20-d509-554a-9926-6de715cb67ac with identifier: CY69823
2026-03-27 20:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35383e20-d509-554a-9926-6de715cb67ac with scrape type 1
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35383e20-d509-554a-9926-6de715cb67ac
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F10%252F2810ec324c137c676d2d13746c17ac31%252Fpa%252FCY69823_259ea673941e573ab437110732a85b96.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_259ea673941e573ab437110732a85b96.jpg already downloaded
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F10%252F2810ec324c137c676d2d13746c17ac31%252Fpa%252FCY69823_8cd7d4a6a2c98acdee3e3e2e84524273.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_8cd7d4a6a2c98acdee3e3e2e84524273.jpg already downloaded
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F10%252F2810ec324c137c676d2d13746c17ac31%252Fpa%252FCY69823_86d9ee2725cbf2652e1ea967efa9ccaf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_86d9ee2725cbf2652e1ea967efa9ccaf.jpg already downloaded
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F10%252F2810ec324c137c676d2d13746c17ac31%252Fpa%252FCY69823_cd0d7b769bf0b9e471efcf2cab01d9d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_cd0d7b769bf0b9e471efcf2cab01d9d4.jpg already downloaded
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F10%252F2810ec324c137c676d2d13746c17ac31%252Fpa%252FCY69823_ad67ca445b0ebe214e9aafaec8a042b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_ad67ca445b0ebe214e9aafaec8a042b9.jpg already downloaded
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F10%252F2810ec324c137c676d2d13746c17ac31%252Fpa%252FCY69823_01bd4a8fd644da3c87234baa194fdbcf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_01bd4a8fd644da3c87234baa194fdbcf.jpg already downloaded
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F10%252F2810ec324c137c676d2d13746c17ac31%252Fpa%252FCY69823_6b9680e379668ea1ab24fa5ee5f50e66.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_6b9680e379668ea1ab24fa5ee5f50e66.jpg already downloaded
2026-03-27 20:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F10%252F2810ec324c137c676d2d13746c17ac31%252Fpa%252FCY69823_f117ad9da9e9006e068932379dd870ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_f117ad9da9e9006e068932379dd870ca.jpg already downloaded
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F10%252F2810ec324c137c676d2d13746c17ac31%252Fpa%252FCY69823_236001ebb99abccff7b7b0adf25ace2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_236001ebb99abccff7b7b0adf25ace2d.jpg already downloaded
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F10%252F2810ec324c137c676d2d13746c17ac31%252Fpa%252FCY69823_a548f4d21f84406fd89d8204e67771c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_a548f4d21f84406fd89d8204e67771c2.jpg already downloaded
2026-03-27 20:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 35383e20-d509-554a-9926-6de715cb67ac, identifier: CY69823
2026-03-27 20:34:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:34:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:34:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:34:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:34:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3598132d0>
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_4868c6ebbaa5e21c693d7348143263d4.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_4868c6ebbaa5e21c693d7348143263d4.jpg saved to cache
2026-03-27 20:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47cebe66-925b-51d8-aa9d-271032bb0878
2026-03-27 20:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 35383e20-d509-554a-9926-6de715cb67ac with identifier: CY69823
2026-03-27 20:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 35383e20-d509-554a-9926-6de715cb67ac with identifier: CY69823
2026-03-27 20:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 35383e20-d509-554a-9926-6de715cb67ac with identifier: CY69823 to the API
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY69823>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:33:49Z',
 'fuel_type': 'diesel',
 'id': '35383e20-d509-554a-9926-6de715cb67ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY69823',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 190796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_259ea673941e573ab437110732a85b96.jpg',
                'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_8cd7d4a6a2c98acdee3e3e2e84524273.jpg',
                'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_86d9ee2725cbf2652e1ea967efa9ccaf.jpg',
                'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_cd0d7b769bf0b9e471efcf2cab01d9d4.jpg',
                'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_ad67ca445b0ebe214e9aafaec8a042b9.jpg',
                'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_01bd4a8fd644da3c87234baa194fdbcf.jpg',
                'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_6b9680e379668ea1ab24fa5ee5f50e66.jpg',
                'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_f117ad9da9e9006e068932379dd870ca.jpg',
                'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_236001ebb99abccff7b7b0adf25ace2d.jpg',
                'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_a548f4d21f84406fd89d8204e67771c2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35383e20-d509-554a-9926-6de715cb67ac/35383e20-d509-554a-9926-6de715cb67ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_259ea673941e573ab437110732a85b96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35383e20-d509-554a-9926-6de715cb67ac/35383e20-d509-554a-9926-6de715cb67ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_8cd7d4a6a2c98acdee3e3e2e84524273.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35383e20-d509-554a-9926-6de715cb67ac/35383e20-d509-554a-9926-6de715cb67ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_86d9ee2725cbf2652e1ea967efa9ccaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35383e20-d509-554a-9926-6de715cb67ac/35383e20-d509-554a-9926-6de715cb67ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_cd0d7b769bf0b9e471efcf2cab01d9d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35383e20-d509-554a-9926-6de715cb67ac/35383e20-d509-554a-9926-6de715cb67ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_ad67ca445b0ebe214e9aafaec8a042b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35383e20-d509-554a-9926-6de715cb67ac/35383e20-d509-554a-9926-6de715cb67ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_01bd4a8fd644da3c87234baa194fdbcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35383e20-d509-554a-9926-6de715cb67ac/35383e20-d509-554a-9926-6de715cb67ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_6b9680e379668ea1ab24fa5ee5f50e66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35383e20-d509-554a-9926-6de715cb67ac/35383e20-d509-554a-9926-6de715cb67ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_f117ad9da9e9006e068932379dd870ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35383e20-d509-554a-9926-6de715cb67ac/35383e20-d509-554a-9926-6de715cb67ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_236001ebb99abccff7b7b0adf25ace2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35383e20-d509-554a-9926-6de715cb67ac/35383e20-d509-554a-9926-6de715cb67ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/10/2810ec324c137c676d2d13746c17ac31/pa/CY69823_a548f4d21f84406fd89d8204e67771c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 D2 Linje Svart',
 'transmission': 'automatic',
 'trim': 'Linje Svart',
 'year': 2018}
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY69823%27 HTTP/1.1" 200 None
2026-03-27 20:34:37 [auto1.be] INFO: Saving data for CY69823: {'created_time': 1774643677.732308, 'last_price_update_time': 1774643677.732318, 'auction_closing_time': 1774715629.0}
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CY69823') HTTP/1.1" 204 0
2026-03-27 20:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_d187b347517fd3a58ac6074b9e3fa223.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_ca5c10696c4470e2a09aaf9026acb08e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_7440bcc37aa6930a3fb0a147f17f0bd6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:34:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:34:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:34:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:34:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3594e1450>
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_622378056788ef177951a89a4cd241d9.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_622378056788ef177951a89a4cd241d9.jpg saved to cache
2026-03-27 20:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47cebe66-925b-51d8-aa9d-271032bb0878
2026-03-27 20:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_ccbf307b84cf4c22a5399516860851f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_c89bec43960434ed60dd6b5058af9b68.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_93a6b8e36658671cc1e50cb2067ab8fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_5282a6d3eb49318e2e3c6f0c4c37c2a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3623ee65b03f2e61ea51c13dec9692f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_492162313187b964803f19efb33d0040.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352963910>
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_d187b347517fd3a58ac6074b9e3fa223.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_d187b347517fd3a58ac6074b9e3fa223.jpg saved to cache
2026-03-27 20:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12c5b220-e10a-5d3a-a856-7f399d547e65
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb359812550>
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_ca5c10696c4470e2a09aaf9026acb08e.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_ca5c10696c4470e2a09aaf9026acb08e.jpg saved to cache
2026-03-27 20:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc078cf8-fb1d-5be3-b372-af514e3221f4
2026-03-27 20:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_0befa35fd7d702fd4f356f6033df791e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_b4b76528635131ed0de9f40c9aabf86f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a6c190>
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_7440bcc37aa6930a3fb0a147f17f0bd6.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_7440bcc37aa6930a3fb0a147f17f0bd6.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5ceac93-e1c0-5054-97d1-2e87f4891b39
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353562ad0>
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_ccbf307b84cf4c22a5399516860851f5.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_ccbf307b84cf4c22a5399516860851f5.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12c5b220-e10a-5d3a-a856-7f399d547e65
2026-03-27 20:34:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35368fc10>
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_c89bec43960434ed60dd6b5058af9b68.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_c89bec43960434ed60dd6b5058af9b68.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6fba3529-108b-5d2a-b9e6-62c793f85b36
2026-03-27 20:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_7162b497976a910cf9495ceaaf1f7d71.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_658ba02bcbfba3fa75ae1984a6ffc2b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352a2c410>
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_93a6b8e36658671cc1e50cb2067ab8fd.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_93a6b8e36658671cc1e50cb2067ab8fd.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5ceac93-e1c0-5054-97d1-2e87f4891b39
2026-03-27 20:34:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35358c510>
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_5282a6d3eb49318e2e3c6f0c4c37c2a9.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_5282a6d3eb49318e2e3c6f0c4c37c2a9.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc078cf8-fb1d-5be3-b372-af514e3221f4
2026-03-27 20:34:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352968e90>
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_3623ee65b03f2e61ea51c13dec9692f6.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3623ee65b03f2e61ea51c13dec9692f6.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5ceac93-e1c0-5054-97d1-2e87f4891b39
2026-03-27 20:34:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35354e250>
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_492162313187b964803f19efb33d0040.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_492162313187b964803f19efb33d0040.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc078cf8-fb1d-5be3-b372-af514e3221f4
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35293e090>
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_0befa35fd7d702fd4f356f6033df791e.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_0befa35fd7d702fd4f356f6033df791e.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc078cf8-fb1d-5be3-b372-af514e3221f4
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3536e3d50>
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_b4b76528635131ed0de9f40c9aabf86f.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_b4b76528635131ed0de9f40c9aabf86f.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12c5b220-e10a-5d3a-a856-7f399d547e65
2026-03-27 20:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_1bc7059d4aa80deac2c28f7e45ac14f9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3594deed0>
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_7162b497976a910cf9495ceaaf1f7d71.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_7162b497976a910cf9495ceaaf1f7d71.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12c5b220-e10a-5d3a-a856-7f399d547e65
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529cdd10>
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_658ba02bcbfba3fa75ae1984a6ffc2b1.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_658ba02bcbfba3fa75ae1984a6ffc2b1.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47cebe66-925b-51d8-aa9d-271032bb0878
2026-03-27 20:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_a32ed9ac22c9dbbff02a107e6fa04ac1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:34:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:34:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:34:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:34:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b69350>
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_1bc7059d4aa80deac2c28f7e45ac14f9.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_1bc7059d4aa80deac2c28f7e45ac14f9.jpg saved to cache
2026-03-27 20:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47cebe66-925b-51d8-aa9d-271032bb0878
2026-03-27 20:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_43a781e171de9855ee4ea34049ac1600.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_7d3b00a3eff69f75536f3451316b7f59.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_a939227d323c87e5208d48c611add84d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_b87daf9ae68a07b4f8ad2b6601a06bf8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353684690>
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fca%252F45ca60011857f4a7d4e04157ac9654b2%252Fpa%252FXL87749_a32ed9ac22c9dbbff02a107e6fa04ac1.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_a32ed9ac22c9dbbff02a107e6fa04ac1.jpg saved to cache
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12c5b220-e10a-5d3a-a856-7f399d547e65
2026-03-27 20:34:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12c5b220-e10a-5d3a-a856-7f399d547e65, skipping ID generation
2026-03-27 20:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12c5b220-e10a-5d3a-a856-7f399d547e65 with scrape type 1
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12c5b220-e10a-5d3a-a856-7f399d547e65 sending to next pipeline
2026-03-27 20:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12c5b220-e10a-5d3a-a856-7f399d547e65, identifier: XL87749
2026-03-27 20:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12c5b220-e10a-5d3a-a856-7f399d547e65 with identifier: XL87749
2026-03-27 20:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12c5b220-e10a-5d3a-a856-7f399d547e65 with identifier: XL87749
2026-03-27 20:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12c5b220-e10a-5d3a-a856-7f399d547e65 with identifier: XL87749 to the API
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_a32ed9ac22c9dbbff02a107e6fa04ac1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:08:31Z',
 'fuel_type': 'petrol',
 'id': '12c5b220-e10a-5d3a-a856-7f399d547e65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL87749',
 'listing': 'auction',
 'location': 'BE, Gent',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 113135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_a32ed9ac22c9dbbff02a107e6fa04ac1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_827a95ebce4e72934d587afceee86838.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_7162b497976a910cf9495ceaaf1f7d71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_b4b76528635131ed0de9f40c9aabf86f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_ccbf307b84cf4c22a5399516860851f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c5b220-e10a-5d3a-a856-7f399d547e65/12c5b220-e10a-5d3a-a856-7f399d547e65_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/ca/45ca60011857f4a7d4e04157ac9654b2/pa/XL87749_d187b347517fd3a58ac6074b9e3fa223.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2005}
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL87749%27 HTTP/1.1" 200 None
2026-03-27 20:34:39 [auto1.be] INFO: Saving data for XL87749: {'created_time': 1774643679.484705, 'last_price_update_time': 1774643679.484715, 'auction_closing_time': 1774714111.0}
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL87749') HTTP/1.1" 204 0
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_4f0fe2172c60459fbf7dbafe7ab1c164.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353690e10>
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_43a781e171de9855ee4ea34049ac1600.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_43a781e171de9855ee4ea34049ac1600.jpg saved to cache
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc078cf8-fb1d-5be3-b372-af514e3221f4
2026-03-27 20:34:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529eded0>
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_7d3b00a3eff69f75536f3451316b7f59.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_7d3b00a3eff69f75536f3451316b7f59.jpg saved to cache
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc078cf8-fb1d-5be3-b372-af514e3221f4
2026-03-27 20:34:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b2f010>
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_a939227d323c87e5208d48c611add84d.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_a939227d323c87e5208d48c611add84d.jpg saved to cache
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47cebe66-925b-51d8-aa9d-271032bb0878
2026-03-27 20:34:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35289d790>
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_b87daf9ae68a07b4f8ad2b6601a06bf8.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_b87daf9ae68a07b4f8ad2b6601a06bf8.jpg saved to cache
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc078cf8-fb1d-5be3-b372-af514e3221f4
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_138cb57f8291e46b694f5318c63e169f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_c7ad3405c9e1df1d13f611aa5a6ae9c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3535017d0>
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_4f0fe2172c60459fbf7dbafe7ab1c164.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_4f0fe2172c60459fbf7dbafe7ab1c164.jpg saved to cache
2026-03-27 20:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47cebe66-925b-51d8-aa9d-271032bb0878
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_682fe79e5ecf37b78a41f2766abb9b57.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_c95f8eb4179845e561e94681591016ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_59ffd4657b9d3e48d5de19ee2bd87233.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_65a3b92b3d43a7f9df98b29e6fc3a728.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_79846a52fc27cdfe05383a2ec3df04a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_1210402ea410549cd98f70966751bdee.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:34:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:34:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:34:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:34:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b40f10>
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_138cb57f8291e46b694f5318c63e169f.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_138cb57f8291e46b694f5318c63e169f.jpg saved to cache
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47cebe66-925b-51d8-aa9d-271032bb0878
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b58110>
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_c7ad3405c9e1df1d13f611aa5a6ae9c6.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_c7ad3405c9e1df1d13f611aa5a6ae9c6.jpg saved to cache
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6fba3529-108b-5d2a-b9e6-62c793f85b36
2026-03-27 20:34:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352ae3850>
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_682fe79e5ecf37b78a41f2766abb9b57.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_682fe79e5ecf37b78a41f2766abb9b57.jpg saved to cache
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc078cf8-fb1d-5be3-b372-af514e3221f4
2026-03-27 20:34:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353560910>
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F55%252Fe15517728208a8618e6c6a7788b8d699%252Fpa%252FZW68449_c95f8eb4179845e561e94681591016ea.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_c95f8eb4179845e561e94681591016ea.jpg saved to cache
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc078cf8-fb1d-5be3-b372-af514e3221f4
2026-03-27 20:34:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc078cf8-fb1d-5be3-b372-af514e3221f4, skipping ID generation
2026-03-27 20:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc078cf8-fb1d-5be3-b372-af514e3221f4 with scrape type 1
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc078cf8-fb1d-5be3-b372-af514e3221f4 sending to next pipeline
2026-03-27 20:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc078cf8-fb1d-5be3-b372-af514e3221f4, identifier: ZW68449
2026-03-27 20:34:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35357b8d0>
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_59ffd4657b9d3e48d5de19ee2bd87233.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_59ffd4657b9d3e48d5de19ee2bd87233.jpg saved to cache
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77863e2a-4114-5928-bcad-56eaadd19805
2026-03-27 20:34:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353431850>
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_65a3b92b3d43a7f9df98b29e6fc3a728.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_65a3b92b3d43a7f9df98b29e6fc3a728.jpg saved to cache
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77863e2a-4114-5928-bcad-56eaadd19805
2026-03-27 20:34:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35340e510>
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_79846a52fc27cdfe05383a2ec3df04a9.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_79846a52fc27cdfe05383a2ec3df04a9.jpg saved to cache
2026-03-27 20:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47cebe66-925b-51d8-aa9d-271032bb0878
2026-03-27 20:34:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353432f50>
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_1210402ea410549cd98f70966751bdee.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_1210402ea410549cd98f70966751bdee.jpg saved to cache
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77863e2a-4114-5928-bcad-56eaadd19805
2026-03-27 20:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc078cf8-fb1d-5be3-b372-af514e3221f4 with identifier: ZW68449
2026-03-27 20:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc078cf8-fb1d-5be3-b372-af514e3221f4 with identifier: ZW68449
2026-03-27 20:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc078cf8-fb1d-5be3-b372-af514e3221f4 with identifier: ZW68449 to the API
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_c95f8eb4179845e561e94681591016ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 261,
 'expiration_date': '2026-03-28T16:57:07Z',
 'fuel_type': 'hybrid',
 'id': 'dc078cf8-fb1d-5be3-b372-af514e3221f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW68449',
 'listing': 'auction',
 'location': 'BE, Vilvoorde',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 103654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_43a781e171de9855ee4ea34049ac1600.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3296091,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_c95f8eb4179845e561e94681591016ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3082704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_b87daf9ae68a07b4f8ad2b6601a06bf8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2695014,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_682fe79e5ecf37b78a41f2766abb9b57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_0befa35fd7d702fd4f356f6033df791e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3160608,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_7d3b00a3eff69f75536f3451316b7f59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_492162313187b964803f19efb33d0040.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_ca5c10696c4470e2a09aaf9026acb08e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_8ffa54b6504fe2458ce84c16a3733a0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc078cf8-fb1d-5be3-b372-af514e3221f4/dc078cf8-fb1d-5be3-b372-af514e3221f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857468,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/55/e15517728208a8618e6c6a7788b8d699/pa/ZW68449_5282a6d3eb49318e2e3c6f0c4c37c2a9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid R-Design 2WD',
 'transmission': 'automatic',
 'trim': 'R-Design 2WD',
 'year': 2020}
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW68449%27 HTTP/1.1" 200 None
2026-03-27 20:34:41 [auto1.be] INFO: Saving data for ZW68449: {'created_time': 1774643681.367469, 'last_price_update_time': 1774643681.367479, 'auction_closing_time': 1774717027.0}
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZW68449') HTTP/1.1" 204 0
2026-03-27 20:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_b2c5a44f548500ddf6d4bf5073acd93c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_48ca6a83078fe3864b4a4c7b1c977b47.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_fd42d5dba7309e9b4e3c1e9f0e465fc1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_581ddb58f4e482b0b9e03a964c15d4e7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_8585b88a00f69a95ba8df22132884a36.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_8042451fa073f14004d01f8b3a3ca8cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_68882854923540403e08a1e2dc869860.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb353579890>
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_b2c5a44f548500ddf6d4bf5073acd93c.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_b2c5a44f548500ddf6d4bf5073acd93c.jpg saved to cache
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77863e2a-4114-5928-bcad-56eaadd19805
2026-03-27 20:34:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:34:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:34:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:34:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:34:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b30ad0>
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_48ca6a83078fe3864b4a4c7b1c977b47.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_48ca6a83078fe3864b4a4c7b1c977b47.jpg saved to cache
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47cebe66-925b-51d8-aa9d-271032bb0878
2026-03-27 20:34:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35295a690>
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_fd42d5dba7309e9b4e3c1e9f0e465fc1.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_fd42d5dba7309e9b4e3c1e9f0e465fc1.jpg saved to cache
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77863e2a-4114-5928-bcad-56eaadd19805
2026-03-27 20:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_f680083d621894ddba520a487e91b331.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3528a75d0>
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_581ddb58f4e482b0b9e03a964c15d4e7.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_581ddb58f4e482b0b9e03a964c15d4e7.jpg saved to cache
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6fba3529-108b-5d2a-b9e6-62c793f85b36
2026-03-27 20:34:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529b8890>
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_8585b88a00f69a95ba8df22132884a36.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_8585b88a00f69a95ba8df22132884a36.jpg saved to cache
2026-03-27 20:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5ceac93-e1c0-5054-97d1-2e87f4891b39
2026-03-27 20:34:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534ea150>
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffc%252Fa8fc5dd7dff838ae55c1da7152422a09%252Fpa%252FSD15124_8042451fa073f14004d01f8b3a3ca8cc.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_8042451fa073f14004d01f8b3a3ca8cc.jpg saved to cache
2026-03-27 20:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47cebe66-925b-51d8-aa9d-271032bb0878
2026-03-27 20:34:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47cebe66-925b-51d8-aa9d-271032bb0878, skipping ID generation
2026-03-27 20:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47cebe66-925b-51d8-aa9d-271032bb0878 with scrape type 1
2026-03-27 20:34:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47cebe66-925b-51d8-aa9d-271032bb0878 sending to next pipeline
2026-03-27 20:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 47cebe66-925b-51d8-aa9d-271032bb0878, identifier: SD15124
2026-03-27 20:34:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b30190>
2026-03-27 20:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_68882854923540403e08a1e2dc869860.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_68882854923540403e08a1e2dc869860.jpg saved to cache
2026-03-27 20:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5ceac93-e1c0-5054-97d1-2e87f4891b39
2026-03-27 20:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124
2026-03-27 20:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124
2026-03-27 20:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124 to the API
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_8042451fa073f14004d01f8b3a3ca8cc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:38Z',
 'fuel_type': 'diesel',
 'id': '47cebe66-925b-51d8-aa9d-271032bb0878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD15124',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 225805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386959,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_4868c6ebbaa5e21c693d7348143263d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373583,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_48ca6a83078fe3864b4a4c7b1c977b47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358124,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_622378056788ef177951a89a4cd241d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3050736,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_8042451fa073f14004d01f8b3a3ca8cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_138cb57f8291e46b694f5318c63e169f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_4f0fe2172c60459fbf7dbafe7ab1c164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3089792,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_79846a52fc27cdfe05383a2ec3df04a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_658ba02bcbfba3fa75ae1984a6ffc2b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395079,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_1bc7059d4aa80deac2c28f7e45ac14f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47cebe66-925b-51d8-aa9d-271032bb0878/47cebe66-925b-51d8-aa9d-271032bb0878_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2834259,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fc/a8fc5dd7dff838ae55c1da7152422a09/pa/SD15124_a939227d323c87e5208d48c611add84d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'manual',
 'trim': 'xLine',
 'year': 2016}
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-27 20:34:42 [auto1.be] INFO: Saving data for SD15124: {'created_time': 1774643682.572923, 'last_price_update_time': 1774643682.572933, 'auction_closing_time': 1774715198.0}
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD15124') HTTP/1.1" 204 0
2026-03-27 20:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb35354e250>
2026-03-27 20:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_f680083d621894ddba520a487e91b331.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_f680083d621894ddba520a487e91b331.jpg saved to cache
2026-03-27 20:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6fba3529-108b-5d2a-b9e6-62c793f85b36
2026-03-27 20:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_bf5fa7b4a06f9b8e140aa76b34878f36.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_bc8694f576783acf5dec3fe99b286ad9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_138a5f8cf7dac1feff1319329d0cd1fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_f5f0d837d119cf1aee12555f53275628.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_0ecddb74ad76e3f9987900112c688350.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:34:42 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1659 | hits on page: 40
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: HL14568
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-27 20:34:42 [auto1.be] INFO: Scrape type for AV28567: 0
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: BW89679
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-27 20:34:42 [auto1.be] INFO: Scrape type for XB17770: 0
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-27 20:34:42 [auto1.be] INFO: Scrape type for LP07116: 0
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-27 20:34:42 [auto1.be] INFO: Scrape type for CE65833: 0
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-27 20:34:42 [auto1.be] INFO: Scrape type for VP78411: 0
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: KV58178
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-27 20:34:42 [auto1.be] INFO: Scrape type for HB98543: 0
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: JX31629
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX31629%27 HTTP/1.1" 200 None
2026-03-27 20:34:42 [auto1.be] INFO: Scrape type for JX31629: 0
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-27 20:34:42 [auto1.be] INFO: Scrape type for UU07035: 0
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-27 20:34:42 [auto1.be] INFO: Scrape type for YK80434: 0
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-27 20:34:42 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-27 20:34:42 [auto1.be] INFO: Scrape type for GF65026: 2
2026-03-27 20:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026
2026-03-27 20:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40b69ed5-a932-5905-a3d4-cdf0da70402e with scrape type 2
2026-03-27 20:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40b69ed5-a932-5905-a3d4-cdf0da70402e with scrape type 2
2026-03-27 20:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40b69ed5-a932-5905-a3d4-cdf0da70402e, identifier: GF65026
2026-03-27 20:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026
2026-03-27 20:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026
2026-03-27 20:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026 to the API
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:30:49Z',
 'fuel_type': 'petrol',
 'id': '40b69ed5-a932-5905-a3d4-cdf0da70402e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF65026',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 126051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-27 20:34:43 [auto1.be] INFO: Saving data for GF65026: {'auction_closing_time': 1774715449.0, 'created_time': 1773779689.446213, 'last_price_update_time': 1774643683.331703}
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF65026') HTTP/1.1" 204 0
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: UN53703
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-27 20:34:43 [auto1.be] INFO: Scrape type for WF76478: 0
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-27 20:34:43 [auto1.be] INFO: Scrape type for AL21659: 0
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-27 20:34:43 [auto1.be] INFO: Scrape type for SC36479: 0
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-27 20:34:43 [auto1.be] INFO: Scrape type for JX62848: 0
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-27 20:34:43 [auto1.be] INFO: Scrape type for DY20434: 0
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-27 20:34:43 [auto1.be] INFO: Scrape type for JH02802: 0
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-27 20:34:43 [auto1.be] INFO: Scrape type for LW38679: 0
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-27 20:34:43 [auto1.be] INFO: Scrape type for MV28568: 0
2026-03-27 20:34:43 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-27 20:34:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529c95d0>
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_bf5fa7b4a06f9b8e140aa76b34878f36.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_bf5fa7b4a06f9b8e140aa76b34878f36.jpg saved to cache
2026-03-27 20:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77863e2a-4114-5928-bcad-56eaadd19805
2026-03-27 20:34:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3528b2110>
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F89%252F7b89714224b1d274852ca6744d81b210%252Fpa%252FPB25162_bc8694f576783acf5dec3fe99b286ad9.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_bc8694f576783acf5dec3fe99b286ad9.jpg saved to cache
2026-03-27 20:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77863e2a-4114-5928-bcad-56eaadd19805
2026-03-27 20:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77863e2a-4114-5928-bcad-56eaadd19805, skipping ID generation
2026-03-27 20:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77863e2a-4114-5928-bcad-56eaadd19805 with scrape type 1
2026-03-27 20:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77863e2a-4114-5928-bcad-56eaadd19805 sending to next pipeline
2026-03-27 20:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77863e2a-4114-5928-bcad-56eaadd19805, identifier: PB25162
2026-03-27 20:34:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb352b09d50>
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_138a5f8cf7dac1feff1319329d0cd1fa.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_138a5f8cf7dac1feff1319329d0cd1fa.jpg saved to cache
2026-03-27 20:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fba3529-108b-5d2a-b9e6-62c793f85b36
2026-03-27 20:34:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3534a4210>
2026-03-27 20:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F45%252Fa34579b878f36902c8ec64ead219d855%252Fpa%252FAX12673_f5f0d837d119cf1aee12555f53275628.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_f5f0d837d119cf1aee12555f53275628.jpg saved to cache
2026-03-27 20:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6fba3529-108b-5d2a-b9e6-62c793f85b36
2026-03-27 20:34:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fba3529-108b-5d2a-b9e6-62c793f85b36, skipping ID generation
2026-03-27 20:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fba3529-108b-5d2a-b9e6-62c793f85b36 with scrape type 1
2026-03-27 20:34:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fba3529-108b-5d2a-b9e6-62c793f85b36 sending to next pipeline
2026-03-27 20:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6fba3529-108b-5d2a-b9e6-62c793f85b36, identifier: AX12673
2026-03-27 20:34:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3529e20d0>
2026-03-27 20:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F25%252F352583326b1c38969c6b2b761c863e9d%252Fpa%252FHT09098_0ecddb74ad76e3f9987900112c688350.jpg') HTTP/1.1" 204 0
2026-03-27 20:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_0ecddb74ad76e3f9987900112c688350.jpg saved to cache
2026-03-27 20:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5ceac93-e1c0-5054-97d1-2e87f4891b39
2026-03-27 20:34:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5ceac93-e1c0-5054-97d1-2e87f4891b39, skipping ID generation
2026-03-27 20:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ceac93-e1c0-5054-97d1-2e87f4891b39 with scrape type 1
2026-03-27 20:34:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5ceac93-e1c0-5054-97d1-2e87f4891b39 sending to next pipeline
2026-03-27 20:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5ceac93-e1c0-5054-97d1-2e87f4891b39, identifier: HT09098
2026-03-27 20:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162
2026-03-27 20:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162
2026-03-27 20:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162 to the API
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_bc8694f576783acf5dec3fe99b286ad9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:07:36Z',
 'fuel_type': 'petrol',
 'id': '77863e2a-4114-5928-bcad-56eaadd19805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB25162',
 'listing': 'auction',
 'location': 'BE, Waver',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 15780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_5a92b083b43f8e3f3e5e3b6ede2dd9d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_a5a16a75623c968734d87f7fe46d66f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_754f0628dc289eee67f56ab8270a0606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576020,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_bc8694f576783acf5dec3fe99b286ad9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2550171,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_fd42d5dba7309e9b4e3c1e9f0e465fc1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2565741,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_bf5fa7b4a06f9b8e140aa76b34878f36.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_b2c5a44f548500ddf6d4bf5073acd93c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2407811,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_65a3b92b3d43a7f9df98b29e6fc3a728.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416615,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_59ffd4657b9d3e48d5de19ee2bd87233.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77863e2a-4114-5928-bcad-56eaadd19805/77863e2a-4114-5928-bcad-56eaadd19805_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3239738,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/89/7b89714224b1d274852ca6744d81b210/pa/PB25162_1210402ea410549cd98f70966751bdee.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2023}
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-27 20:34:44 [auto1.be] INFO: Saving data for PB25162: {'created_time': 1774643684.869381, 'last_price_update_time': 1774643684.869392, 'auction_closing_time': 1774714056.0}
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PB25162') HTTP/1.1" 204 0
2026-03-27 20:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673
2026-03-27 20:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673
2026-03-27 20:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673 to the API
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_f5f0d837d119cf1aee12555f53275628.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:36:51Z',
 'fuel_type': 'diesel',
 'id': '6fba3529-108b-5d2a-b9e6-62c793f85b36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX12673',
 'listing': 'auction',
 'location': 'BE, Tradein',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 187259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2705088,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_7d93fd26c4b99ffd4debfcc2b74bada1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2706669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_58222fff279c8d2375fe0026914549e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2737366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_96241a9b4800de442817020967f0a633.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_0cf7eccd071ea3f9946701f9772b36fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2701021,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_138a5f8cf7dac1feff1319329d0cd1fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2758815,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_f5f0d837d119cf1aee12555f53275628.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_f680083d621894ddba520a487e91b331.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2774972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_581ddb58f4e482b0b9e03a964c15d4e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2727362,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_c89bec43960434ed60dd6b5058af9b68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba3529-108b-5d2a-b9e6-62c793f85b36/6fba3529-108b-5d2a-b9e6-62c793f85b36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/45/a34579b878f36902c8ec64ead219d855/pa/AX12673_c7ad3405c9e1df1d13f611aa5a6ae9c6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2015}
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-27 20:34:45 [auto1.be] INFO: Saving data for AX12673: {'created_time': 1774643685.270479, 'last_price_update_time': 1774643685.270492, 'auction_closing_time': 1774715811.0}
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX12673') HTTP/1.1" 204 0
2026-03-27 20:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098
2026-03-27 20:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098
2026-03-27 20:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098 to the API
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_0ecddb74ad76e3f9987900112c688350.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:58Z',
 'fuel_type': 'diesel',
 'id': 'c5ceac93-e1c0-5054-97d1-2e87f4891b39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT09098',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 150197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3505949,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_4c419a4f2735b6e4b99045481b19ffe6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3551567,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_93bbcff7062c735fd4ccbaea40fb3aeb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3408948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_7440bcc37aa6930a3fb0a147f17f0bd6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3331704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3582b6f688b00a85c1b9b8847e34042a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3cc253720c8ab77767abde0840a7b6cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3334266,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_0ecddb74ad76e3f9987900112c688350.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3082717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_8585b88a00f69a95ba8df22132884a36.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3548716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_68882854923540403e08a1e2dc869860.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3515533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_3623ee65b03f2e61ea51c13dec9692f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ceac93-e1c0-5054-97d1-2e87f4891b39/c5ceac93-e1c0-5054-97d1-2e87f4891b39_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2838152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/25/352583326b1c38969c6b2b761c863e9d/pa/HT09098_93a6b8e36658671cc1e50cb2067ab8fd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-27 20:34:45 [auto1.be] INFO: Saving data for HT09098: {'created_time': 1774643685.635811, 'last_price_update_time': 1774643685.635825, 'auction_closing_time': 1774715038.0}
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT09098') HTTP/1.1" 204 0
2026-03-27 20:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:46 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1659 | hits on page: 40
2026-03-27 20:34:46 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-27 20:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-27 20:34:46 [auto1.be] INFO: Scrape type for DT24627: 0
2026-03-27 20:34:46 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-27 20:34:46 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-27 20:34:46 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-27 20:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-27 20:34:46 [auto1.be] INFO: Scrape type for RL32581: 2
2026-03-27 20:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581
2026-03-27 20:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 620966a7-3c70-5cb5-8c5c-af38cada22a5 with scrape type 2
2026-03-27 20:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 620966a7-3c70-5cb5-8c5c-af38cada22a5 with scrape type 2
2026-03-27 20:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 620966a7-3c70-5cb5-8c5c-af38cada22a5, identifier: RL32581
2026-03-27 20:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581
2026-03-27 20:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581
2026-03-27 20:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581 to the API
2026-03-27 20:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:45Z',
 'fuel_type': 'petrol',
 'id': '620966a7-3c70-5cb5-8c5c-af38cada22a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL32581',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 105444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-27 20:34:47 [auto1.be] INFO: Saving data for RL32581: {'auction_closing_time': 1774714305.0, 'created_time': 1773866517.693449, 'last_price_update_time': 1774643687.109258}
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL32581') HTTP/1.1" 204 0
2026-03-27 20:34:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:47 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-27 20:34:47 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-27 20:34:47 [auto1.be] INFO: Scrape type for JW58136: 0
2026-03-27 20:34:47 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-27 20:34:47 [auto1.be] INFO: Scrape type for DG02903: 0
2026-03-27 20:34:47 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-27 20:34:47 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-27 20:34:47 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-27 20:34:47 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-27 20:34:47 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-27 20:34:47 [auto1.be] INFO: Scrape type for FM00077: 2
2026-03-27 20:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077
2026-03-27 20:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c62131b-6bd9-5295-bb76-6402d0846a1d with scrape type 2
2026-03-27 20:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c62131b-6bd9-5295-bb76-6402d0846a1d with scrape type 2
2026-03-27 20:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c62131b-6bd9-5295-bb76-6402d0846a1d, identifier: FM00077
2026-03-27 20:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077
2026-03-27 20:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077
2026-03-27 20:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077 to the API
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:03:13Z',
 'fuel_type': 'diesel',
 'id': '2c62131b-6bd9-5295-bb76-6402d0846a1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM00077',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 129301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-15',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-27 20:34:47 [auto1.be] INFO: Saving data for FM00077: {'auction_closing_time': 1774713793.0, 'created_time': 1774254698.200148, 'last_price_update_time': 1774643687.53795}
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FM00077') HTTP/1.1" 204 0
2026-03-27 20:34:47 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-27 20:34:47 [auto1.be] INFO: Scrape type for KP74596: 2
2026-03-27 20:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596
2026-03-27 20:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with scrape type 2
2026-03-27 20:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with scrape type 2
2026-03-27 20:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648, identifier: KP74596
2026-03-27 20:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596
2026-03-27 20:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596
2026-03-27 20:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596 to the API
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:54:11Z',
 'fuel_type': 'petrol',
 'id': '81029d9f-3bc6-57b9-aff2-c5b6c81c5648',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP74596',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 143314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-24',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel Edition',
 'transmission': 'manual',
 'trim': 'Feel Edition',
 'year': 2014}
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-27 20:34:47 [auto1.be] INFO: Saving data for KP74596: {'auction_closing_time': 1774716851.0, 'created_time': 1773747412.202757, 'last_price_update_time': 1774643687.983705}
2026-03-27 20:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP74596') HTTP/1.1" 204 0
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Scrape type for PB67516: 2
2026-03-27 20:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516
2026-03-27 20:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f34dfec1-d751-59e7-972b-8aecf26a3c83 with scrape type 2
2026-03-27 20:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f34dfec1-d751-59e7-972b-8aecf26a3c83 with scrape type 2
2026-03-27 20:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f34dfec1-d751-59e7-972b-8aecf26a3c83, identifier: PB67516
2026-03-27 20:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516
2026-03-27 20:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516
2026-03-27 20:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516 to the API
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:55:18Z',
 'fuel_type': 'diesel',
 'id': 'f34dfec1-d751-59e7-972b-8aecf26a3c83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB67516',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 312233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Combi L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Combi L2H1 2,9t',
 'year': 2017}
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Saving data for PB67516: {'auction_closing_time': 1774716918.0, 'created_time': 1773779950.412741, 'last_price_update_time': 1774643688.382783}
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PB67516') HTTP/1.1" 204 0
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: YJ60132
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Scrape type for FC28046: 0
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Scrape type for GL29646: 0
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Scrape type for ZR23499: 0
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Scrape type for CG39340: 0
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: FJ69250
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Scrape type for RU19747: 0
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Scrape type for ZR56949: 0
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Scrape type for RP30975: 0
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Scrape type for WB95668: 0
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Scrape type for RX75304: 0
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: CB60498
2026-03-27 20:34:48 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Scrape type for NP23299: 2
2026-03-27 20:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299
2026-03-27 20:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with scrape type 2
2026-03-27 20:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with scrape type 2
2026-03-27 20:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72, identifier: NP23299
2026-03-27 20:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299
2026-03-27 20:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299
2026-03-27 20:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299 to the API
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:10Z',
 'fuel_type': 'petrol',
 'id': '7c97d0b5-b7c0-55cc-b081-a6bb755f8a72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP23299',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 58429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-10',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-27 20:34:48 [auto1.be] INFO: Saving data for NP23299: {'auction_closing_time': 1774716010.0, 'created_time': 1773224571.095282, 'last_price_update_time': 1774643688.935451}
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP23299') HTTP/1.1" 204 0
2026-03-27 20:34:49 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-27 20:34:49 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-27 20:34:49 [auto1.be] INFO: Found listing with ID: YU75052
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU75052%27 HTTP/1.1" 200 None
2026-03-27 20:34:49 [auto1.be] INFO: Scrape type for YU75052: 2
2026-03-27 20:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8549377-f838-5dee-b17b-b40b39d6ed10 with identifier: YU75052
2026-03-27 20:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8549377-f838-5dee-b17b-b40b39d6ed10 with scrape type 2
2026-03-27 20:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8549377-f838-5dee-b17b-b40b39d6ed10 with scrape type 2
2026-03-27 20:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f8549377-f838-5dee-b17b-b40b39d6ed10, identifier: YU75052
2026-03-27 20:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f8549377-f838-5dee-b17b-b40b39d6ed10 with identifier: YU75052
2026-03-27 20:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f8549377-f838-5dee-b17b-b40b39d6ed10 with identifier: YU75052
2026-03-27 20:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f8549377-f838-5dee-b17b-b40b39d6ed10 with identifier: YU75052 to the API
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:59:32Z',
 'fuel_type': 'diesel',
 'id': 'f8549377-f838-5dee-b17b-b40b39d6ed10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU75052',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 174866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-17',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Van ECOnetic',
 'transmission': 'manual',
 'trim': 'Van ECOnetic',
 'year': 2014}
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU75052%27 HTTP/1.1" 200 None
2026-03-27 20:34:49 [auto1.be] INFO: Saving data for YU75052: {'auction_closing_time': 1774717172.0, 'created_time': 1773137187.929313, 'last_price_update_time': 1774643689.387157}
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU75052') HTTP/1.1" 204 0
2026-03-27 20:34:49 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-27 20:34:49 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-27 20:34:49 [auto1.be] INFO: Scrape type for KU11213: 0
2026-03-27 20:34:49 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-27 20:34:49 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-27 20:34:49 [auto1.be] INFO: Scrape type for BP14655: 0
2026-03-27 20:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:52 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1659 | hits on page: 40
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-27 20:34:52 [auto1.be] INFO: Scrape type for FG88533: 0
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-27 20:34:52 [auto1.be] INFO: Scrape type for XE73160: 0
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-27 20:34:52 [auto1.be] INFO: Scrape type for PC96861: 2
2026-03-27 20:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861
2026-03-27 20:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db3aabd-187e-5b20-b476-734ae3ac1f01 with scrape type 2
2026-03-27 20:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1db3aabd-187e-5b20-b476-734ae3ac1f01 with scrape type 2
2026-03-27 20:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1db3aabd-187e-5b20-b476-734ae3ac1f01, identifier: PC96861
2026-03-27 20:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861
2026-03-27 20:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861
2026-03-27 20:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861 to the API
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:54Z',
 'fuel_type': 'diesel',
 'id': '1db3aabd-187e-5b20-b476-734ae3ac1f01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC96861',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 205828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-04',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2017}
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-27 20:34:52 [auto1.be] INFO: Saving data for PC96861: {'auction_closing_time': 1774716174.0, 'created_time': 1773301753.190102, 'last_price_update_time': 1774643692.456423}
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC96861') HTTP/1.1" 204 0
2026-03-27 20:34:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-27 20:34:52 [auto1.be] INFO: Scrape type for AE23838: 0
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-27 20:34:52 [auto1.be] INFO: Scrape type for HP14917: 2
2026-03-27 20:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917
2026-03-27 20:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with scrape type 2
2026-03-27 20:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with scrape type 2
2026-03-27 20:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de, identifier: HP14917
2026-03-27 20:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917
2026-03-27 20:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917
2026-03-27 20:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917 to the API
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:52:40Z',
 'fuel_type': 'diesel',
 'id': '808abb3b-0ea3-5f95-8e22-e7eaed99a6de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP14917',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 170964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-11',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 d Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2013}
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-27 20:34:52 [auto1.be] INFO: Saving data for HP14917: {'auction_closing_time': 1774716760.0, 'created_time': 1773747710.539213, 'last_price_update_time': 1774643692.938134}
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HP14917') HTTP/1.1" 204 0
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: ZD51863
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-27 20:34:52 [auto1.be] INFO: Scrape type for HB19534: 0
2026-03-27 20:34:52 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-27 20:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Scrape type for ND89972: 0
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Scrape type for HL95749: 0
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Scrape type for CB86664: 0
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Scrape type for CA72484: 2
2026-03-27 20:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484
2026-03-27 20:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d0e83ae-50c5-5e36-a54e-a86862682694 with scrape type 2
2026-03-27 20:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d0e83ae-50c5-5e36-a54e-a86862682694 with scrape type 2
2026-03-27 20:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4d0e83ae-50c5-5e36-a54e-a86862682694, identifier: CA72484
2026-03-27 20:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484
2026-03-27 20:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484
2026-03-27 20:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484 to the API
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:44:32Z',
 'fuel_type': 'diesel',
 'id': '4d0e83ae-50c5-5e36-a54e-a86862682694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA72484',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 54019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Live M',
 'transmission': 'manual',
 'trim': 'Live M',
 'year': 2021}
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Saving data for CA72484: {'auction_closing_time': 1774716272.0, 'created_time': 1774254701.393151, 'last_price_update_time': 1774643693.424311}
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA72484') HTTP/1.1" 204 0
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Scrape type for LG37246: 0
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Scrape type for PF95077: 0
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Scrape type for NC25574: 0
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Scrape type for WP69561: 0
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Scrape type for GP69185: 0
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Scrape type for YX48939: 0
2026-03-27 20:34:53 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-27 20:34:53 [auto1.be] INFO: Scrape type for TH19224: 0
2026-03-27 20:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:54 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1659 | hits on page: 40
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for XM93272: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for XJ47711: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for DB63111: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for NM63028: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for EP14144: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for SA79242: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for RR03336: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for SJ78748: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for ZN76480: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for BD10300: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for XE15288: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for AX51995: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for SR34780: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-27 20:34:54 [auto1.be] INFO: Scrape type for CP91123: 0
2026-03-27 20:34:54 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-27 20:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-27 20:34:55 [auto1.be] INFO: Scrape type for WK50026: 2
2026-03-27 20:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026
2026-03-27 20:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a916bf6-add1-537b-9d8a-3fb9c166f590 with scrape type 2
2026-03-27 20:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a916bf6-add1-537b-9d8a-3fb9c166f590 with scrape type 2
2026-03-27 20:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a916bf6-add1-537b-9d8a-3fb9c166f590, identifier: WK50026
2026-03-27 20:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026
2026-03-27 20:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026
2026-03-27 20:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026 to the API
2026-03-27 20:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:05:03Z',
 'fuel_type': 'petrol',
 'id': '5a916bf6-add1-537b-9d8a-3fb9c166f590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK50026',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 131300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-10',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2016}
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-27 20:34:56 [auto1.be] INFO: Saving data for WK50026: {'auction_closing_time': 1774713903.0, 'created_time': 1773133087.392684, 'last_price_update_time': 1774643696.347164}
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WK50026') HTTP/1.1" 204 0
2026-03-27 20:34:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:56 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-27 20:34:56 [auto1.be] INFO: Scrape type for ZR84759: 0
2026-03-27 20:34:56 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-27 20:34:56 [auto1.be] INFO: Scrape type for GD11285: 0
2026-03-27 20:34:56 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-27 20:34:56 [auto1.be] INFO: Scrape type for WK14396: 0
2026-03-27 20:34:56 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-27 20:34:56 [auto1.be] INFO: Scrape type for SA37733: 0
2026-03-27 20:34:56 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-27 20:34:56 [auto1.be] INFO: Scrape type for DY28234: 0
2026-03-27 20:34:56 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-27 20:34:56 [auto1.be] INFO: Scrape type for ED70069: 0
2026-03-27 20:34:56 [auto1.be] INFO: Found listing with ID: VV01116
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV01116%27 HTTP/1.1" 200 None
2026-03-27 20:34:56 [auto1.be] INFO: Scrape type for VV01116: 0
2026-03-27 20:34:56 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-27 20:34:56 [auto1.be] INFO: Scrape type for ST89131: 0
2026-03-27 20:34:56 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-27 20:34:56 [auto1.be] INFO: Scrape type for FJ79675: 0
2026-03-27 20:34:56 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-27 20:34:56 [auto1.be] INFO: Found listing with ID: NY53837
2026-03-27 20:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:58 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1659 | hits on page: 40
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for WC98842: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for FH97290: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for JS18374: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for VF88831: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for BC49055: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for TF03002: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for TZ99758: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for WW99205: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: FV40639
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for UX15937: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for MJ08102: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: JU84298
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for JZ88652: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for JX00156: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for EW63431: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: BC23353
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: WC70774
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC70774%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for WC70774: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for XK61886: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for FN69818: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: RL41837
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL41837%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for RL41837: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for VZ63754: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: DB52098
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB52098%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for DB52098: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for PR84870: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: NM84983
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84983%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for NM84983: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: TD45447
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD45447%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for TD45447: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: MB97201
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB97201%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for MB97201: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: JF18972
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for FA61625: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for XU03064: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: GN38450
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN38450%27 HTTP/1.1" 200 None
2026-03-27 20:34:58 [auto1.be] INFO: Scrape type for GN38450: 0
2026-03-27 20:34:58 [auto1.be] INFO: Found listing with ID: YA37935
2026-03-27 20:34:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:34:59 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1659 | hits on page: 19
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: PL26855
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL26855%27 HTTP/1.1" 200 None
2026-03-27 20:34:59 [auto1.be] INFO: Scrape type for PL26855: 0
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-27 20:34:59 [auto1.be] INFO: Scrape type for MR51068: 0
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: BP74088
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP74088%27 HTTP/1.1" 200 None
2026-03-27 20:34:59 [auto1.be] INFO: Scrape type for BP74088: 0
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: JJ45584
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-27 20:34:59 [auto1.be] INFO: Scrape type for RA11008: 0
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-27 20:34:59 [auto1.be] INFO: Scrape type for XT87195: 0
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-27 20:34:59 [auto1.be] INFO: Scrape type for UT35373: 0
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-27 20:34:59 [auto1.be] INFO: Scrape type for XZ54371: 0
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-27 20:34:59 [auto1.be] INFO: Scrape type for AU32211: 0
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-27 20:34:59 [auto1.be] INFO: Found listing with ID: JE06286
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE06286%27 HTTP/1.1" 200 None
2026-03-27 20:34:59 [auto1.be] INFO: Scrape type for JE06286: 0
2026-03-27 20:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:00 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1659 | hits on page: 0
2026-03-27 20:35:00 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 20:35:00 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-27 20:35:00 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 44, <ScrapeType.BATCH_SKIPPED: 5>: 26}
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774211700 HTTP/1.1" 200 None
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AC43000') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AF15006') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BE09168') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BS02363') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BX08054') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CA02835') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CA58839') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CD16659') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CF49225') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CH13880') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DH21833') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EB02823') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ED46370') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EF54277') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EK87829') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FA92658') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FL95093') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FY63763') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GW83912') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GZ17047') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HE03711') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HE87666') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HF56754') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HW17277') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JD91497') HTTP/1.1" 204 0
2026-03-27 20:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JG11053') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JV09749') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KE39524') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KK03534') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KV20865') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KY91040') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LA84805') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LB58597') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LC72864') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LD88636') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LT39267') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MP96756') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MR86591') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NE45749') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PD03709') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PE65808') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PP77245') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PV94378') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SB58546') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SC78990') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SE11504') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SN22557') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ16034') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TE71134') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TG22305') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TV36896') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TW96115') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UC69886') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UC87367') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UE22995') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UW55016') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UZ53017') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VF67772') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VN13572') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VR35184') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VS19517') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VX95038') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ40374') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XG78459') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XL93198') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XM16083') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XP10716') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XT82010') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YD97678') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ14798') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YP74474') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZK58976') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU62623') HTTP/1.1" 204 0
2026-03-27 20:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY64497') HTTP/1.1" 204 0
2026-03-27 20:35:01 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (349 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-27T20_30_00.jl
2026-03-27 20:35:01 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 5,
 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 5,
 'downloader/request_bytes': 1269197,
 'downloader/request_count': 729,
 'downloader/request_method_count/GET': 684,
 'downloader/request_method_count/POST': 45,
 'downloader/response_bytes': 382257314,
 'downloader/response_count': 724,
 'downloader/response_status_count/200': 724,
 'dupefilter/filtered': 6,
 'elapsed_time_seconds': 294.66096,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 20, 35, 1, 428153, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 349,
 'log_count/DEBUG': 9358,
 'log_count/INFO': 9373,
 'memusage/max': 207556608,
 'memusage/startup': 147959808,
 'photo_download_count': 469,
 'request_depth_max': 46,
 'response_received_count': 255,
 'scheduler/dequeued': 729,
 'scheduler/dequeued/memory': 729,
 'scheduler/enqueued': 729,
 'scheduler/enqueued/memory': 729,
 'scrape_type/batch_skipped': 820,
 'scrape_type/new': 104,
 'scrape_type/price_update': 245,
 'scrape_type/skipped': 524,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 255,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.3379370893552585,
 'scrapy-zyte-api/mean_response_seconds': 3.3748191216704893,
 'scrapy-zyte-api/processed': 255,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 255,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 254,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 255,
 'scrapy-zyte-api/request_args/httpRequestBody': 45,
 'scrapy-zyte-api/request_args/httpRequestMethod': 45,
 'scrapy-zyte-api/request_args/httpResponseBody': 255,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 255,
 'scrapy-zyte-api/request_args/sessionContext': 255,
 'scrapy-zyte-api/request_args/url': 255,
 'scrapy-zyte-api/status_codes/200': 255,
 'scrapy-zyte-api/success': 255,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1699,
 'source/total_available': 1659,
 'start_time': datetime.datetime(2026, 3, 27, 20, 30, 6, 767193, tzinfo=datetime.timezone.utc)}
2026-03-27 20:35:01 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-27 20:35:01 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb35955e3d0>
2026-03-27 20:35:01 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb35968bd10>